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D.  Exptr iaents 


The  EEGSL  is  in  the  process  of  developing  the  aethod  of  Neurocognitive 
Pattern  (NCP)  Analysis  for  Measuring  aspects  of  Mass  neural  processes 
related  to  per ceptuoaotor  and  cognitive  activities*  Several 
generations  of  NCP  Analysis  have  been  used  to  study  both  coaplex  and 
siaple  tasks*  and  a  nuaber  of  findings  have  eaerged.  Taken  together* 
these  results  suggest  that  neither  strictly  locali2ationist  nor 
equipotentialist  views  of  neurocognitive  functioning  are  realistic* 
Since  even  siaple  tasks  are  associated  with  a  rapidly  shifting  aosaic 
of  focal  scalp-recorded  patterns*  neurocognitive  functioning  eight  be 
better  aodeled  as  a  network  in  which  the  activity  of  aany  specialized 
local  processing  eleaents  is  periodically  integrated*  Our  research  is 
directed  toward  developing  aethods  for  Measuring  these  processes  aore 
precisely  and  Modeling  thea  aore  explicitly* 

N.B.  It  aust  be  understood  that  scalp-recorded  potentials*  even 
unaveraged  tiaeseries*  are  not  necessarily  cortical  in  origin*  Until 
this  issue  is  settled*  it  is  essential  not  to  interpret  scalp 
designations*  which  conventionally  refer  to  underlying  cortical  areas* 
as  iap lying  aeasureaent  of  the  activity  of  cortical  sources*  For 
convenience*  we  use  the  convential  scalp  designations  subject  to  this 
caveat . 

Specific  findings  include! 

1*  Coaplex  perceptuoaotor  and  cognitive  activities  such  as 
reading  and  writing  have  unique*  spatially  differentiated  scalp  EEC 
spectral  patterns.  These  patterns  had  sufficient  specificity  to 
identify  the  type  of  task  froa  the  EEC  < EEC  Clin.  Neurophvsiol . 
475693-703*  1979).  The  results  were  in  accord  with  previous  reports 

of  heaispheric  lateralization  of  'spatial*  and  'linguistic* 
processing . 

2.  When  tasks  are  controlled  for  stiaulus*  response  and 
perf oraance-related  factors*  coaplex  cognitive  activities  such  as 
arithaetic*  letter  substitution  and  aental  block  rotation  have 
identical*  spatially  diffuse  EEC  spectral  scalp  distributions. 
Coapared  with  staring  at  a  dot*  such  tasks  had  approxiaately  10% 
reductions  in  alpha  and  beta  band  spectral  intensities  < EEG  Clin. 
Neurophvsiol.  47!  704-710*  19795  Science  2035665-668*  1979).  This 
reduction  aay  be  an  index  of  their  task  workload.  Since  no  patterns 
of  heaispheric  lateralization  were  found*  this  study  suggested  that 
previous  reports  of  EEG  heaispheric  lateralization  aay  have  confounded 
EEG  patterns  related  to  liab  and  eye  aoveaents  and  arousal  with  those 
of  aental  activity  per  tf  ( Science  20751005-1008*  1980). 

3.  Split-second  visuoaotor  tasks*  controlled  so  that  only  the 
type  of  judgaent  varied*  are  associated  with  coaplex*  .rapidly  shifting 
patterns  of  single-trial*  evoked  inter-electrode  correlation  of  brain 
potential  tiaeseries.  Differences  between  spatial  and  nuaeric 
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judgments  were  evident  in  the  task-cued  prestiaulus  interval.  Coaplex 
and  often  lateralized  patterns  of  difference  shifted  with  split-second 
rapidity  froa  stiaulus  onset  to  just  prior  to  response'  at  which  tiae 
there  was  no  difference  between  spatial  and  nuaeric  tasks  (Science 
213*918-922'  1981).  This  suggested  that  once  task-specific 

differential  perceptual  and  cognitive  processing  was  coapleted'  a 
aotor  prograa  coaaon  to  both  tasks  was  executed'  regardless  of 
differences  in  the  stiauli  or  type  of  judgaent. 

4.  Rapidly  shifting'  focal  brain  potential  patterns' 

representing  the  aaxiaal  difference  between  siailar  split-second 
tasks'  can  be  extracted  with  NCP  analysis.  The  aove  and  no-aove 
variants  of  a  split-second  visuospatial  judgaent  task'  which  differed 
slightly  in  expectation*  differed  in  type  of  judgaent*  and  differed 
greatly  in  response*  were  associated  with  distinct  differences  in  the 
patterns  of  single-trial  evoked  correlation  between  scalp-recorded 
channels  (Science  220J97-99*  1983>  see  Sections  III  and  IV).  These 
patterns  of  difference  increased  in  aagnitude  in  each  successive 
analysis  interval.  In  the  prestiaulus  interval'  correlation  of  the 
aidline  frontal  electrode  distinguished  the  tasks  (p<.01).  In  the 
interval  spanning  the  Nl*  P2  and  N2  event-related  potential  (ERP) 
peaks*  the  between-task  evoked  correlation  contrast  was  focused  at  the 
aidline  parietal  electrode  (p<«001).  In  the  interval  centered  on  the 
P3a  ERP  peak*  the  focus  of  correlation  difference  was  at  the  right 
parietal  electrode  and  involved  higher  correlation  of  the  right 
parietal  with  occipital  and  aidline  precentral  electrodes  in  the 
no-aove  task'  and  with  the  right  central  electrode  in  the  aove  task 
(p<5  x  10  a).  In  an  interval  centered  135  asec  after  the  P3a  ERP 
peak*  which  included  right-handed  response  preparation  and  initiation* 
the  focus  of  contrast  shifted  to  the  left  central  electrode*  involving 
higher  correlation  with  aidline  frontal  and  occipital  electrodes  in 
the  aove  task  ang  with  the  aidline  parietal  electrode  in  the  no-aove 
task  p<5  x  10  )•  These  results  concur  with  neuropsychological 

aodels  of  these  tasks  derived  froa  clinical  observations.  They 
suggest  that  although  siaple  perceptuoaotor  tasks  are  associated  with 
a  coaplex*  dynaaic  aosaic  of  brain  electrical  patterns*  it  is  possible 
to  isolate  foci  of  aaxiaal  differences  between  tasks.  It  is  clear 
that  without  a  split-second  teaporal  resolution  it  is  not  possible  to 
isolate  the  rapid  shift  in  lateralization  which  presuaably  is 
associated  with  perceptual-cognitive  and  efferent  processing  stages. 

5.  The  focal  patterns  of  evoked  correlation  derived  by  NCP 
analysis  significantly  distinguished  the  single-trial  data  of  7  of  the 
9  people  in  the  above  study.  This  suggested  that  siailar 
neurocognitive  aechanisas  were  being  aeasured  across  the  aajority  of 
participants  (see  Section  IV). 

6.  Behaviorally  identical  trials  of  the  aove  and  no-aove 
visuospatial  tasks  in  the  above  study  were  found  to  be  associated  with 
distinctly  different  brain  potential  patterns  (Section  VI).  This 
suggests  that  appropriate  brain  potential  aeasures  aay  provide  a  tool 
for  aore  detailed  exaaination  of  previously  unaeasured  neurocognitive 
processes. 


—r 
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E.  Analytic  Hethods 


Neurocognitive  Pattern  (NCP)  analysis  currently  consists  of  the 
application  of  an  adaptive-network*  nonlinear  eatheeatical  pattern 
classification  algorithm  to  extract  task-related  signals  froe  sets  of 
data*  The  analysis  is  applied  to  single-trial  tieeseries  in  brief 
tiee  windows  (100  to  175  asec)  for  up  to  49  scalp  electrodes  (using 
power  eeasures)  and  up  to  1176  electrode  pairings  (using 
crosscorrelation  or  crosscovariance  eeasures)*  The  data  windows  are 
detereined  for  each  person  froe  the  peaks  of  their  averaged  ERPs  as 
well  as  froe  stieulus  and  response  times*  but  eeasures  are  eade  on 
single  trials* 


1*  Similarities  tod  Differences  Between  N£P  Analysis  «&£ 
Conventional  ERP  Analysis 

NCP  analysis  is  grounded  on  the  vast  body  of  inforeation  gained  froe 
ERP  eethods  and  has  the  saee  underlying  goal*  naeely  to  resolve 
spatially  and  teeporally  overlapping*  task-related  eass  neural 
processes*  However*  it  departs  in  several  ways  froe  the  currently 
popular  approach  of  extracting  independent  features  froe  averaged  ERPs 
by  principal  coeponents  analysis  (PCA)  followed  by  hypothesis  testing 
with  ANOVA.  First*  NCP  analysis  is  concerned  with  spatioteeporal 
task-related  activity  recorded  by  eanv  electrodes  in  a  nuaber  of  tiee 
intervals  froe  before  the  stieulus  through  the  response.  It 
quantifies  neurocognitive  activity  in  teres  of  a  variety  of 
paraeeters*  rather  than  aaplitude  and  latency  of  ERP  coeponents* 
Thus*  it  is  possible  that  the  increased  dieensional ity  of 
paraeetr ization  eay  facilitate  the  eeasureeent  of  subtler  aspects  of 
neurocognitive  processes.  Second*  the  questionable  assueption  of  a 
eultivariate  noreal  distribution  of  brain  potentials  is  not  eade  in 
NCP  analysis.  Third*  brain-potential  feature  extraction  and 
hypothesis  testing  are  perforeed  as  a  single  process  which  detereines 
features  which  are  eaxieally  different  between  the  conditions  of  an 
experieent*  rather  than  those  which  eeet  possibly  irrelevant  criteria 
such  as  statistical  independence.  Fourth*  task-related  patterns  of 
consistency  are  extracted  froe  sets  of  single-trial  data*  Significant 
results  eay  be  obtained  as  long  as  there  is  a  pattern  of  consistent 
difference  between  tasks*  even  though  the  means  of  the  two  data  sets 
do  not  differ  significantly. 

Taken  together*  these  aspects  of  NCP  analysis  eay  enable  it  to  resolve 
small  task-related  signals  froe  the  obscuring  background  'noise*  of 
the  brain*  revealing  useful  spatioteeporal  inforeation  about  eass 
neural  processes*  However*  this  is  not  without  its  costs*  NCP 
analysis  requires  several  orders  of  magnitude  more  computing  than  PCA 
and  ANOVA*  and  larger  data  sets  than  conventional  ERP  studies*  Also* 
because  of  its  sensitivity*  highly  controlled  experimental  paradigms 
are  required  to  assure  that  the  results  are  truly  related  to  the 
hypothesis  and  not  to  spurious  or  idiosyncratic  factors*  (The  process 
of  developing  one  such  task  is  described  in  Section  II  of  this 
report.)  This  requires  a  greater  allocation  of  effort  and  resources 
to  experimental  design*  recording  and  analysis  than  is  needed  for  most 
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ERP  experiments 


Although  we  have  obtained  several  promising  results  with  NCP  analysis? 
the  latest  of  which  is  described  in  Sections  III  and  IV?  we  must 
caution  that  ’the  jury  is  still  out-*.  Additional  basic  studies  are 
needed  to  determine  whether  NCP  analysis  is  really  worthwhile?  If  so? 
it  should  be  possible  to  optimize?  standardize  and  simplify  it  for  use 
in  other  laboratories? 

2?  Evoked  Correlations  Between  Scalp  Electrodes 

For  the  past  few  years  we  have  concentrated  on  a  measure  of  the  degree 
of  waveshape  similarity  (crosscorrelation)  between  timeseries  from 
pairs  of  electrodes?  Measures  of  single  channel  power  are  also  being 
used  and  will  be  reported  later  this  year?  The  crosscorrelation 
approach  is  based  on  the  (unproven)  hypothesis  that  when  areas  of  the 
brain  are  functionally  related  there  is  a  consistent  pattern  of 
waveshape  similarity  between  them?  There  are  a  number  of 
considerations  in  interpreting  the  correlation  patterns  of  scalp 
recordings?  such  as  volume  conduction  from  subcortical  sources  and 
driving  by  distant  sources?  Some  of  the  ambiguities  may  be  mitigated 
by  careful  experimental  design?  but  the  neurophysiological 
interpretation  of  correlation  patterns  is  an  unsettled  issue? 

Besides  the  scientific  value  of  studying  the  neural  activity 
associated  with  preparation  to  receive  and  the  subsequent  processing 
of  numeric  information  in  two  sense  modalities?  the  auditory-visual 
experiment  described  in  this  Interim  Progress  Report  is  designed  to 
provide  a  data  base  for  refining  the  NCP  analysis  and  investigating 
some  aspects  of  the  neurophysiological  interpretation  of  correlation 
patterns?  In  addition  to  inter-channel?  zero-lag  correlation?  NCP 
analysis  can  employ  other  measures  such  as  multi-lagged  correlation 
and  covariance?  and  single  channel  power?  all  in  specific  frequency 
bands?  Preliminary  studies  described  in  this  report  (Section  V)  have 
revealed  significant  information' with  such  measures?  A  major  goal 
during  the  coming  year  is  to  explore  and  resolve  some  of  these  issues? 


II.  giQTIHC  Q£  AUDITORY-VISUAL  PERCEPTUOMOTOR  USH 
a.  Puian  EqntititrgUgnj 

A  number  of  issues  had  to  be  addressed  in  designing  a  bimodal  paradigm 
sufficiently  controlled  to  reveal  NCPs  which  might  distinguish 
auditory  end  visual  perceptuomotor  tasks  during  the  modality-cued 
prestimulus  and  post-stimulus  intervals? 

1.  Cognitive  Considerations 

Two  hypotheses  are  being  tested?  First?  NCPs  should  show 
neuroanstomicelly  inter pretable  differences  between  the  processing  of 
auditory  and  visual  numeric  stimuli  in  post-stimulus  intervals  when 
feature  extraction  is  thought  to  occur  in  sensory  and  related  cortical 
areas?  There  should  be  minimal  differences  after  sense-specific 

.  5 


processing  is  completed.  Second*  NCPs  should  differ  in  the 
modality-cued  prestieulus  interval  is  a  function  of  the  preparation  to 
receive  either  visual  or  auditory  stimuli.  The  second  hypothesis 
requires  complete  equivalence  of  cue  properties  and 
performance-related  factors  between  auditory  and  visual  conditions? 
and  also  a  strong  inference  that  a  modality-specific  expectancy  set 
exists  in  the  cued  prestimulus  interval# 

2.  Experimental  Control 

The  first  hypothesis  (ie»  post-stimulus  processing)  requires  control 
of  stimulus?  response  and  performance-related  factors  across 
conditions  so  that  the  major  difference  between  conditions  is  stimulus 
modality*  Visual  and  auditory  modalities  have  fundamental 
differences.  Input  for  the  former  is  parallel  (for  brief  foveally 
presented  stimuli)?  while  for  the  latter  it  is  serial.  Inherent 
differences  in  auditory  and  visual  processing  latencies  can  be 
compensated  for  by  centering  several  analysis  windows  on  the  average 
ERP  peak  latencies  in  each  person  for  auditory  and  visual  conditions 
separately.  Differences  in  ERP  amplitudes  can  be  explicitly  measured 
by  NCP  analysis  of  single-channel  signal  power.  With  regard  to  the 
second  hypothesis  (ie.  prestimulus  attentional  set)?  the  modality-cued 
paradigm  elicits  a  contingent  negative  variation  (CNV)  between  cue  and 
stimulus?  with  consequent  resolution  after  stimulus  presentation.  NCP 
analysis  will  be  applied  to  measure  pre-  and  post-stimulus  modality 
differences.  The  results  may  shed  some  light  on  the  interface  between 
preparatory  activity  and  post-stimulus  processes. 

3 .  Montage 

A  21  electrode  scalp  montage  suitable  for  recording  activity  over 
auditory  visual?  motor?  parietal  and  dorsolateral  prefrontal  cortices 
was  used  during  these  pilot  recordings.  Four  additional  channels 
recorded  vertical  and  horizontal  EOC?  EMG  and  the  response.  The  final 
design  will  expand  this  to  49  brain  potential  channels  to  allow  a 
resolution  of  approximately  6  square  centimeters  (see  section  II.C.). 
The  investigation  and  conclusions  concerning  these  issues  during  the 
developmental  program  of  12  pilot  recordings  is  reported  in  the 
following  section. 

B.  Task  development  and  pilot  recordings 

1.  Pins*  fin*  ♦1-8) (Respond  is  all£Mli> 

a.  Rationale.  The  existence  of  a  modality-specific 
prestimulus  attentional  set  was  investigated  with  the  *miscueing* 
technique  (Posner?  1978).  In  this  method  a  randomly  ordered  20X  of 
the  modality  cues  (a  visually  presented  letter  in  both  conditions)  are 
incorrect.  The  lengthening  of  mean  response  time  in  these  miscued 
trials  is  considered  the  'cost*  incurred  by  the  expectation  of  a 
stimulus  in  a  specific  modality?  and  is  used  to  infer  the  existence  of 
a  modality-specific  preparatory  set. 


b.  Task .  Stimulus  presentation  and  response  measurement 
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were  performed  by  the  reel  time  subsystem  of  the  ADIEEG  system*  which 
also  digitized  the  25  channels  of  physiological  signals  at  256 
samples/sec.  The  participant  <P>  was  instructed  to  fixate  a  point  at 
the  center  of  the  CRT  screen  of  an  AED  II  graphics  terminal  and  await 
a  visually  presented  modality  cue  (V  for  visual*  A  for  auditory* 
duration  375  msec)  1*5  sec  later  the  stimulus  was  presented* 

Auditory  stimuli  consisted  of  the  numbers  1  to  9  generated  by  a  Votrax 
speech  synthesizer  and  presented  through  two  speakers  about  2  ft. 
above  the  participant's  head*  Duration  varied  from  245  to  430  msec 
(the  number  7  was  generated  as  aSEVN*).  Visual  stimuli  were  single 
digit  numbers  presented  on  the  CRT*  subtending  a  visual  angle  of  under 
one  degree.  Their  duration  was  equated  to  that  of  their  corresponding 
auditory  numeric  stimuli* 

The  participant  was  instructed  to  attend  the  modality  cue  and  ‘focus 
his  attention’  on  the  speakers  or  screen  as  indicated  by  the  cue* 
while  maintaining  his  gaze  on  the  screen*  He  was  to  respond  to  the 
stimulus  without  hesitation  with  a  ballistic  contraction  of  his  right 
hand  index  finger  on  a  modified  Grass  force  transducer  with  a  pressure 
corresponding  to  the  stimulus  number  on  a  linear  scale  of  1  to  9. 
Feedback  indicating  the  exact  pressure  applied  was  presented  as  a  2 
digit  number  on  the  CRT  screen  (duration  375  msec)  1  second  after 
completion  of  response  as  determined  by  the  program* 

If  the  response  was  sufficiently  accurate*  the  feedback  number  was 
underlined*  signifying  a  ‘win’.  The  error  tolerance  for  a  ‘win’  was 
continually  adjusted  throughout  the  session  as  a  moving  average  of  the 
accuracy  of  the  preceeding  five  correctly  cued  trials  in  visual  and 
auditory  modalities  separately* 

A  random  18%  of  the  trials  were  miscued  (ie.  the  stimulus  .arrived  in 
the  wrong  modality).  The  participant  was  to  respond  to  these  just 
like  the  correctly  cued  trials*  Correctly  cued  and  miscued  auditory 
and  visual  trials  were  presented  in  randomly  ordered  blocks  of  17 
trials*  self-initiated  by  the  participant. 

c.  Recordings.  Eight  normal*  right-handed  adult  male 
participants  were  recorded  in  pilot  sessions  consisting  of  about  350 
to  700  trials  each*  Three  were  personal  of  the  EECSL  and  5  were  naive 
paid  participants*  Details  were  settled  during  the  first  6 
recordings*  and  technically  acceptable  recordings  were  obtained  from 
the  last  2  people.  The  electrode  montage  was  Fz»  F7*  F8*  aFl*  aF2* 
Cz*  C3 *  C4 *  C5 *  C6 *  Pz*  P3*  P4*  T3*  T4*  T5»  T6*  0z*  aOl  and  e02* 
referenced  to  linked  mastoids  (modified  expanded  10-20  system 
nomenclature)  Picton*  et  al*  1978).  For  P*8  several  placements  were 
changed  (see  section  B.2)*  Vertical  and  horizontal  eye  movements* 
response  muscle  activity*  and  force  transducer  output  were  also 
recorded.  All  signals  were  amplified  by  a  64-channel  Bioelectric 
Systems  Nodel  AS-64P  amplifier  with  .10  to  100  Hz  passband* 
continuously  digitized  to  11  bits  at  256  samples/sec  and  stored  on 
digital  tape.  Signals  were  also  recorded  on  three  8  channel 
polygraphs  to  monitor  the  session  and  for  off-line  artifact  editing. 
Average  response  times  (RT>  and  error  rate  (proportion  of  ‘lose* 
trials)  were  computed  for  behavioral  evidence  of  a  ‘cost*  due  to  a 
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prestimulus  attentions!  set  in  a  total  data  set  of  3735  trials 


d.  Results  and  Discussion.  For  correctly  coed  trials*  the 
»ean  response  times  were  quicker  for  visual  stimuli  for  all  but  two 
people.  Average  RT  across  P's  was  675  msec  for  visual  stimuli  and  711 
msec  for  auditory.  The  longer  RT  for  auditory  stimuli*  which  is 
opposite  to  the  findings  in  simpler  bimodal  paradigms*  may  be  due  to 
the  nature  of  the  verbally  presented  number  stimuli.  All  information 
needed  for  visual  stimulus  decoding  appeared  on  the  screen  within  33 
msec*  while  auditory  information  was  not  completed  for  up  to  several 
hundred  msec.  The  longer  RT  for  the  auditory  stimuli  may  also  be  due 
to  the  use  of  synthesized  speech  stimuli. 

In  the  miscued  trials  a  lengthening  of  RT  and  increase  in  error  rate 
was  observed  in  almost  every  case  (Tables  1  and  2).  For  miscued 
auditory  stimuli  the  average  increase  in  RT  was  47  msec  and  the 
average  increase  in  error  rate  (proportion  of  ’lose*  trials)  was  9X. 
For  misuced  visual  stimuli  the  'costs*  of  miscueing  were  slightly 
greater  (increase  in  RT  *  65  msec?  increase  in  error  rate  *  10Z). 
There  was  a  small  (18  msec)  asymmetry  in  RT  effect.  That  is*  miscueing 
a  visual  stimulus  caused  a  greater  increase  in  RT  than  miscueing  an 
auditory  stimulus.  This  asymmetry  and  the  magnitude  of  the  RT 
lengthening  in  miscued  trials  is  in  agreement  with  previous  studies 
using  simpler  tasks  (Posner*  1978).  Further*  the  standard  deviations 
for  all  cued  and  miscued  conditions  were  similar  within  persons* 
indicating  that  the  RT  'costs'  due  to  miscueing  were  based  on  a 
consistent  effect  rather  than  greater  variability  in  a  smaller  sample 
(about  4  to  1  ratio  of  correctly  vs.  incorrectly  cued  trials.)  Thus 
it  was  verified  that  there  was  a  'cost*  in  the  miscued  trials 
indicative  of  an  attentional  committment  to  a  particular  modality  in 
the  prestimulus  interval. 

The  ERPs  for  one  person  (P#7)  are  illustrated  in  Figure  1.  In  the 
auditory  condition  (Figures  la  and  b)  the  N1  peak  occurred  at  120  msec 
in  correctly  cued  trials  and  136  msec  in  miscued  trials.  Its 
amplitude  was  maximal  at  midline  f ronto-centr al  sites.  The  P2  peak  at 
208  msec  was  maximal  at  midline  fronto-central  sites*  and  was  well 
represented  at  midline  parietal  sites.  In  miscued  auditory  trials 
(Figure  lb)  a  P3  peak  was  apparent  at  314  msec*  maximal  at  the  midline, 
parietal  derivation*  and  extending  to  fronto-central*  lateral  central 
and  lateral  parietal  electrodes. 

The  visual  stimuli  elicited  an  N1  peak  at  150  msec  in  both  correctly 
cued  and  miscued  conditions  (Figures  lc  and  d).  Although  in  this 
person  the  N1  peak  was  clearly  seen  at  the  midline  occipital 
electrode*  it  was  larger  over  left  anterior  occipital  and  posterior 
temporal  sites  (aOl  and  T5).  The  P2  peak,  was  maximal  at  Pz*  where  its 
latency  was  215  msec*  but  at  midline  fronto-central  sites  the  first 
positive  peak  occurred  at  179  msec.  This  earlier  positive  peak  at 
anterior  sites  (which  was  also  observed  in  P48)  was  actually  the 
resolution  of  the  prestimulus  CNV*  which  in  the  auditory  condition  was 
masked  by  the  fronto-central  N1  peak.  In  the  miscued  visual  trials 
(Figure  Id)  a  P3  peak  was  present  at  300  msec  in  P*7  and  330  msec  in 
P*3.  It  was  slightly  larger  at  Cz  than  Pz*  and  was  also  prominent  at 
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midline  frontal  and  lateral  central  and  parietal  electrodes.  The  F'3 
peak  was  of  larger  amplitude?  broader?  and  more  anteriorly  distributed 
in  the  visual  miscued  trials  than  in  the  auditory  miscued  trials. 

fhe  pre-stimulus  CNU  is  evident  as  a  fronto-central  negative 
displacement  of  the  prestimulus  baseline  in  both  conditions  and  its 
resolution  could  occur  at  different  latencies  after  visual  and  verbal 
stimuli.  Also?  the  information  content  of  the  verbal  stimuli  occurred 
at  various  latencies  (as  in  'six*  and  'seven*?  or  'four*  and  "five*? 
as  compared  to  the  other  numbers).  What  effect  this  may  have  upon  the 
latencies  of  endogenous  ERP  components  is  not  known?  but  it  is  likely 
that  greater  variability  of  the  P3  latency  in  the  auditory  condition 
may  account  for  the  smaller?  lower  amplitude  peak.  These  issues  will 
L<e  addressed  in  analyses  of  later?  more  controlled  data  sets. 

A  negative  going  slow  potential  shift  was  observed  to  commence  at  the 
F2  latency  in  all  but  the  miscued  visual  trials?  where  it  may  have 
been  obscured  by  the  robust  P3  peak.  It  was  maximal  at  Cz?  and  larger 
over  the  left  central  (C3)  then  the  right  central  (C4>  electrode. 
This  lateralization  began  well  before  the  average  response  times  in 
each  condition. 

2.  Phase  two  (P's  *9-12 ) S  ( No  response  to  miscues ) 

a .  Rationale . 

The  behavioral  results  of  phase  one  confirmed  the  existence  of  a 
prestimulus  attentional  set?  and  the  respond-to-miscues  design  was 
modified  for  the  formal  recordings  to  a  move/no-move  design  in  which 
the  'response*  to  a  miscued  stimulus  was  to  make  no  movement.  This 
was  done  so  that  there  would  be  a  behavioral  confirmation  of  attention 
to  the  cue  in  each  trial?  and  so  that  post-stimulus  processing  could 
be  examined  in  each  modality  separately  by  a  within-modality?  move  vs 
no-move  NCP  analysis.  The  within-modality  analyses  will  serve  as 
standards  to  aid  in  interpreting  the  results  of  the  between-modal itly 
analyses  > 

b 1  ask .  The  task  was  the  same  as  before?  except  that 
the  participant  was  instructed  to  make  no  response  on  miscued  trials 
(random  20%).  A  monetary  incentive  was  added  by  rewarding  accurate 
(win)  move  trials  as  a  function  of  the  accuracy  attained  (about  5 
cents  for  each  win).  The  accrued  monetary  bonus  was  displayed  at  the 
^r.d  of  each  block  of  17  trials?  as  well  as  the  average  error  tolerance 
for  that  block  (as  a  performance  index)  for  auditory  and  visual 
conditions  separately.  The  cue-to-stimulus  intervals  were  2.5  sec  for 
P's  #9-11?  and  1  sec  for  P#12.  For  P#12  a  separate  run  was  recorded 
at  the  2.5  sec  interval  for  the  visual  modality  only. 

c.  Recordings .  Four  normal?  right-handed  adult  males 
participated  in  sessions  consisting  of  about  100  practice  and  400  test 
trials.  The  21  channel  montage  consisted  of  Fz?  F7?  F8?  aFl.  aF2* 
aCz?  Cz?  C3?  C4?  C5?  C6?  Pz?  P3?  P4?  aP5?  aP6  ?  T5?  16?  Oz ?  aOl  and 
a02?  referenced  to  linked  mastoids.  Tin  scalp  electrodes  were 
attached  using  a  stretchable  nylon  cap  (Electrocap  International > . 


Vertical  and  horizontal  eye  aoveaents  (electrode  at  outer  canthi)  and 
response  auscle  potentials  (EMG  froa  flexor  digitorue)  were  recorded 
with  Ag-AgCl  cup  electrodes.  Other  aspects  of  thr  recording  procedure 
were  the  saae  as  in  Phase  one. 

Trials  were  visually  inspected  off-line  to  eliainate  artifacted  trials 
and  no-aove  trials  where  auscle  activity  was  present  on  the  EMG 
channel.  Average  stiaulus-registered  ERPs  were  coaputed  for  all  scalp 
channels*  as  well  as  averages  of  vertical  and  horizontal  EOG  and  EHG. 
Cue-registered  averages  were  also  coaputed  for  P#12  for  the 
cue-to-stiaulus  interval  (1.  sec  for  this  P>)  the  averaging  epoch 
extended  froa  2S0  asec  before  the  cue  to  250  asec  after  the  stiaulus. 

d.  Results  and  Discussion.  Response  tiae*  error  rate 
(proportion  of  ‘lose*  trials)*  and  average  error  tolerance  in  the  aove 
trials  for  the  4  participants  are  shown  in  Table  3.  Average  response 
tiaes  and  error  rates  were  siailar  across  aove  conditions*  but  the 
adaptive  error  tolerance  (inversely  related  to  skill  level)  tended  to 
be  larger  for  the  auditory  condition*  indicating  that  perforaance  was 
slightly  better  for  visual  stiauli.  Me  will  atteapt  to  eliainate  this 
difference  in  the  foraal  recordings  by  providing  aore  practice  at  the 
auditory  task. 

At  the  2.5  sec  cue-to-stiaulus  interval  (P's  *9-11)*  there  was  a  high 
rate  of  data  attrition  (about  25X)  in  the  no-aove  (aiscued)  trials  due 
to  aistaken  overt  responses.  This  aay  have  been  due  to  a  decay  of  the 
attentional  set.  At  the  1  sec  interval  (P*12)  there  was  no  attrition 
due  to  response  aoveaents.  Since  the  no-aove  trials  are  infrequent* 
the  attrition  •  ate  aust  be  very  low  to  collect  sufficient  data  for 
the  within-aodality  aove  vs  no-aove  NCP  analysis.  Thus  the  1  second 
interval  seeas  aore  desirable. 

The  stiaulus-registered  ERPs  for  the  aove  trials  (Fig.  2a  and  c)  were 
siailar  to  the  correctly  cued  trials  of  Phase  one.  In  the  visual 
condition  the  N1  peak  was  poorly  represented  at  the  aidline  occipital 
electrode*  and  in  P#12  at  the  lateral  occipital  placeaents  also  (Fig. 
2c).  In  all  P's  (including  those  in  Phase  one)  the  N1  peak  to  visual 
stiauli  was  largest  at  the  lateral  posterior  teaporal  sites  (T5  and 
T6).  This  aay  have  been  due  to  the  saall  visual  angle  (under  1 
degree)  subtended  by  the  foveal  stiauli. 

In  P's  •?»  10  and  12  the  no-aove  (aiscued)  trials  elicited  an 

augaentation  of  the  P3  peak.  The  P3  peak  aaplitude  in  both  aove  and 
no-aove  averages  was  aaxiaal  at  aidline  f ronto-central  sites. 
Exaaination  of  vertical  and  horizontal  EOC  channels  revealed  no  eye 
aoveaent  which  would  account  for  this  anterior  distribution)  thus  it 
was  aost  likely  due  to  the  resolution  of  a  prestieulus  CNV*  an  issue 
to  be  addressed  in  the  foraal  study. 

A  frontally-doainant  negative  displaceaent  of  the  pre-stieulus 
baseline  (CNV)  was  seen  in  all  participants.  In  a  cued  paradiga  such 
as  this  a  CNV  aay  well  be  concoaitant  to  the  expectancy  set  we  wish  to 
study  (reviewed  by  Tecce*  1972).  The  cue-registered  averages  for  the 
1  sec  interval  (P912)  revealed  the  tiae-course  of  the  prestieulus  CNV 
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to  correctly  coed  auditory  and  visual  stimuli.  The  negativity  was 
largest  at  the  isidline  f ronto-central  electrodes*  but  did  not  see*  to 
differ  between  modalities.  NCP  analysis  of  the  cue-to-stiaulus 
interval  in  the  fornal  study  *ay  shed  *ore  light  on  the 
*odal ity-specif icity  of  the  anatoaical  distribution  of  CNV-related 
activity*  which  has  not  been  thoroughly  exaained  (Ritter*  et  al* 
1980). 

C.  Final  Paradigm  Screening  of  Participants 

As  of  1  JUN  83*  one  full  recording  has  been  *ad*.  1000  trials  were 

recorded  fro*  a  well-practiced  participant  using  the  parediga* 
electrode  montage*  and  recording  procedure  described  above.  The 
cue-to-sti»ulus  interval  was  1  sec*  the  visual  stiauli  were  thickened 
and  increased  in  size  to  just  under  a  2  degree  visual  angle*  and  the 
proportion  of  aiscued  (no-go)  trials  was  increased  to  222.  ERPs  fro* 
this  recording  were  quite  satisfactory  in  aost  respects. 

This  paradiga*  and  a  49  channel  scalp  aontage  (Figure  3)  will  be  used 
in  the  foraal  experiment.  A  common  average  reference  will  be 
computed*  and  the  passband  will  be  .1  to  50  Hz  with  digitization  at 
128  Hz.  A  recent  study  of  triaodal  attentional  set  using  the  regional 
cerebral  blood  flow  technique  (Roland*  1982)  has  revealed  that  the 
spatial  patterns  of  focal  neural  processes  related  to  attention  and 
aodality  processing  are  complex  even  when  viewed  with  a  30  sec 
temporal  resolution.  In  order  to  adequately  sample  brain  potentials 
which  may  correspond  to  these  regions  of  focal  activation*  denser 
coverage  of  dorsolateral  prefrontal  areas*  superior  and  inferior 
posterior  parietal  and  superior  and  posterior  temporal  areas  is 
required. 

A  screening  program  is  being  conducted  to  select  and  train  candidate 
participants.  During  screening  sessions  EEGs  are  recorded  from  Fz* 
Cz*  Pz*  aOl  and  a02  (to  examine  the  ERP  waveform)*  and  T1  and  T2  (to 
assess  potentials  fro*  temporalis  muscles).  Vertical  and  horizontal 
eye-movements  are  recorded  by  a  single  pair  of  diagonally  placed 
electrodes.  Behavioral  records  are  exaained  to  assess  the  quality  of 
task  performance*  polygraphs  are  inspected  to  determine  the  amount  of 
data  attrition  due  to  artifact*  and  average  ERPs  are  computed  to 
verify  the  presence  of  expected  peaks.  Participants  for  the  formal 
study  will  be  drawn  from  these  candidates.  To  date  (1  JUN  83)  17 
candidates  have  been  screened  in  this  manner*  6-8  of  whoa  will  be 
recalled  for  the  formal  experiment. 
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Table  1  -  Average  response  tiae  (in  asec)  and  standard  deviation  for 

correctly  cued  and  aiscued  auditory  and  visual  trials  for  the 
8  participants  recorded  in  phase  one  of  task  developaent. 
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T able  2  -  Error  rate  (X  of  ’lose*  trials)  in  correctly  cued  and 

•iscued  auditory  and  visual  conditions  in  phase  ona  of  task 
develop*ent«  (Hiscued  trials  *  18X). 
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Table  3  Response  tieesr  error  rate  (%  lose  trials)  and  error  tolerance 
(inversely  related  to  skill  level)  for  phase  two  <P‘s  #9-12 >» 
•ove/no*»ove  design. 
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Figure  Is  -  Auditory  correctly  cued  condition;  eversge  event-related  potentials 
for  selected  channels  for  p#7.  (91  trials,  .1  to  100  Hz  passband) 
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Figure  lb  -  Auditory  mlscued  condition  with  response  (p#7,  27  trials) 
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Figure  Id  -  Visual  aiscuad  condition  with  response  (p#7,  31  trials) 
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n*,r«  2.  -  Auditory  corroctly  eo.d  Cov.)  coodition.  *"W  ™t-r.l.trf 
potentials  from  selected  channels  from  p#12  (103  trials,  .1  to 

100  Hz  passband). 
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Figure  2c-  Visual  correctly  cued  (move)  condition.  (p#12,  98  trials). 
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Shadows  of  Thought:  Shifting  Lateralization  of  Human 
Brain  Electrical  Patterns  Daring  Brief  Vbaomotor  Tadi 

Abstract.  Dynamic  spatial  patterns  of  correlation  <4  electrical  potentials  recorded 
from  the  human  brain  were  shown  in  diagrams  generated  by  mathematical  pattern 
recognition.  The  patterns  for  "move"  and  "no-move"  variants  of  a  brief  visuospa- 
tial  task  were  compared.  In  the  interval  spanning  the  P300  peak  of  the  evoked 
potential,  higher  correlations  of  the  right  parietal  electrode  with  occipital  and  central 
electrodes  distinguished  the  no-move  task  from  the  move  task.  In  the  next  interval, 
spanning  the  readiness  potential  in  the  move  task,  higher  correlations  of  the  left 
central  electrode  with  occipital  and  frontal  electrodes  characterized  the  move  task. 
These  results  conform  to  neuropsychological  expectations  of  localized  processing 
and  their  temporal  sequence.  The  rapid  change  in  the  side  and  site  of  localized 
processes  may  account  for  conflicting  reports  of  lateralization  in  studies  which 
lacked  adequate  spatial  and  temporal  resolution. 


Many  investigators  have  reported  that 
brain  activity  is  lateraiized  during  cogni¬ 
tive  tasks.  Advanced  radiological  meth¬ 
ods  reveal  relative  localization  and  later¬ 
alization.  but  cannot  resolve  temporal 
sequencing  because  of  the  long  time  re¬ 
quired  for  observation.  Studies  of  on¬ 
going.  background  electrical  activity  do 
not  reveal  split-second  changes  in  neuro- 
cognitive  patterns,  and  those  that  have 
reported  lateralization  of  neurocognitive 
activity  have  been  questioned  on  meth¬ 
odological  grounds  </-6).  Although  the 

i  Ann.  iso 


components  of  averaged  event-related 
potentials  (ERF's)  may  indicate  the  se¬ 
quencing  of  some  neurocognitive  pro¬ 
cesses,  they  have  not  revealed  consist¬ 
ent,  robust  signs  of  lateralization,  even 
for  language.  (7).  Conclusions  derived 
from  patients  with  focal  brain  lesions  or 
with  “split-brains."  cannot  be  directly 
extended  to  normal  subjects.  Lateraiized 
processes  inferred  from  reaction  time 
differences  to  hemifleld  or  dkhotic  stim¬ 
ulation  have  also  been  questioned  on 
methodological  grounds  (ff).  These  fac- 
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ton  have  undoubtedly  contributed  to 
confiictiag  reports  of  lateralization  of 
brain  activity. 

To  observe  the  spatial  patterns  and 
sequencing  of  neurocognitive  activity, 
we  have  developed  a  new  method  called 
neurocognitive  pattern  (NCP)  analysis, 
la  NCP  analysts  the  average  ERP’s  of 
each  person  are  used  to  determine  the 
time  intervals  of  task-related  neural 
processes.  Within  these  intervals  the 
similarity  of  brain-potential  waveshapes 
over  the  scalp  is  measured  on  a  single¬ 
trial  basis  by  computing  the  cross-corre¬ 
lation  coefficient  between  paired  combi¬ 
nations  of  electrodes.  Although  the  neur- 
nenitnmir  origin  and  neurophysiological 
sjgaihrinrr  of  these  correlations  is  not 
known,  it  has  been  suggested  that  cogni¬ 
tive  activity  may  be  associated  with 
characteristic  scalp  correlation  patterns 
(9).  However,  task-related  electrical  sig¬ 
nals  from  the  brain  are  spatially  smeared 
in  transmission  to  the  scalp  and  are  em¬ 
bedded  in  background  activity.  Since 
linear  statistical  methods  were  not  effec¬ 
tive  in  dealing  with  these  obstacles,  we 
used  a  mote  powerful  analysis  called 
trainable  classification-network  mathe¬ 
matical  patten  recognition  (2. 3, 10-13). 
For  this  method,  artificial  intelligence 
aigoridans  are  used  to  extract  patterns  of 
correlation  that  differ  between  two  con¬ 
ditions  with  no  assumptions  about  the 
distribution  of  correlation  values.  The 
algorithm  is  first  applied  Ur  a  labeled 
subset  of  the  experimental  data  called 
the  training  set.  and  the  invariant  pat¬ 
terns  (classification  functions)  found  are 
then  verified  on  a  separate  unlabeled 
subset  of  data  called  the  test  set.  If  the 
classification  (Unctions  can  significantly 
separate  the  test  set  into  the  two  condi¬ 
tion*.  the  extracted  patterns  have  intrin¬ 
sic  validity. 

Previously  we  repotted  the  existence 
of  complex,  rapidly  changing  patterns 
of  brain-potential  correlation  involving 
many  areas  of  both  hemispheres  that 
distinguished  numeric  and  spatial  judg¬ 
ments  in  a  visuotnotor  task  (13).  Since 
the  sequencing  of  neurocognitive  differ¬ 
ences  between  numeric  and  spatial  proc¬ 
essing  is  not  definitely  known,  the  com¬ 
plex  patterns  were  difficult  to  interpret. 
The  present  experiment  was  designed  to 
clarify  this  situation  by  highlighting  pre¬ 
sumably  localized  neural  processes.  In 
comparing  two  types  of  spatial  judg¬ 
ment,  the  common  activity  of  brain  areas 
should  cancel,  revealing  differences  in 
the  right  parietal  am  presumed  to  medi¬ 
ate  spatial  judgments.  The  right-handed- 
finger  response  in  one  task  was  designed 
to  elicit  lateraiized  activity  of  the  left 
central  motor  area. 

*7 
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la  this  study  a  person  estimated  the 
distance  a  “target”  should  be  moved  to 
intersect  a  displayed  arrow's  trajectory. 
The  “move"  task  required  pressure  of 
the  right  index  finger  on  a  transducer 
with  a  force  proportional  to  that  distance 
(M).  In  the  “no-move”  task  the  arrow 
pointed  directly  at  the  target,  and  no 
pressing  was  required  (pseudorandom  20 
percent  of  trials).  Thus,  the  spatial  judg¬ 
ment  and  response  differed  between 
tasks,  while  gross  stimulus  characteris¬ 
tics  were  the  same. 

Nine  right-handed,  healthy  adults 
(eight  males,  one  female)  participated  in 
the  study.  The  average  response  initia¬ 
tion  (muscle  potential  onset)  time  for  the 
move  trials  was  0.59  second  (standard 
deviation,  0.19;  mean  of  standard  devi¬ 


ations  within  persons,  0.24).  Brain  po¬ 
tentials  were  recorded  from  15  scalp 
electrodes  and  referenced  to  Knir«H  mas- 
toids  (Fig.  1A)  (15).  Vertical  and  hori¬ 
zontal  eye  movements,  muscle  poten¬ 
tials  from  the  responding  finger,  and  the 
output  of  the  force  transducer  were  also 
recorded.  The  data  were  edited  to  re¬ 
move  trials  with  artifacts,  and  a  set  of 
1612  correct,  representative  trials  (839 
move,  773  no-move)  was  formed.  Aver¬ 
aged  ERP’s  were  computed  for  all  elec¬ 
trodes  (Fig.  IB),  and  Meats  and  analyses 
of  variance  (ANOVA’s)  were  performed 
(16,  IT). 

Cross-correlations  were  computed  be¬ 
tween  91  paired  combinations  of  the  15 
electrodes  for  each  trial  in  each  of  three 
175-msec  intervals  (Fig.  IB).  Two  inter¬ 


vals  spanned  the  N100-P200  and  P300 
ERP  peaks,  and  the  third  (RP)  interval 
spanned  most  of  the  readiness  potential 
(in  the  move  task).  The  cenurpomt  of 
each  interval  was  determined  for  each 
person  (IS).  The  correlations  were  stan¬ 
dardized  within  persons,  within  elec¬ 
trode  pairs  (mean,  0;  standard  deviation, 
1),  and  then  grouped  across  people.  The 
Meats  and  ANOVA's  of  single-trial  cor¬ 
relations  did  not  distinguish  meaningful 
differences  in  between- task  spatiotempo- 
ral  patterns. 

Mathematical  pattern  classification 
was  then  applied  to  the  single-trial  corre¬ 
lations  of  ail  nine  people  to  search  for 
subtle  betwecn-task  differences  in  each 
interval.  To  make  the  results  anatomical¬ 
ly  interpretable,  we  performed  the 
search  separately  on  each  of  15  sets  of 
electrode  pairs.  Each  set  consisted  of  the 
correlations  of  a  particular  electrode 
with  ten  other  electrodes  (Fig.  1C).  For 
each  interval,  the  electrode  set  that  dis¬ 
tinguished  conditions  on  the  test  set  with 
the  highest  significance  level  (19),  and 
the  most  prominent  correlations  for  that 
electrode  set  (20),  were  diagramed. 

In  the  N100-P200  interval,  correla¬ 
tions  of  the  midline  parietal  electrode 
distinguished  the  tasks  (P  <  .001)  (Fig. 
2A).  In  the  P300  interval,  correlations  of 
the  right  parietal  electrode  with  the  mid¬ 
line  occipital  and  precentral  electrodes 
were  greater  in  the  no-move  task,  while 
correlations  of  the  right  parietal  with  the 
right  central  electrode  were  greater  in 
the  move  task  (P  <  5  x  10~5)  (Fig.  2B). 
In  the  RP  interval,  correlations  of  the  left 
central  electrode  with  the  midline  frontal 
and  occipital  electrodes  were  greater  in 
the  move  task,  while  correlations  of  the 
left  central  electrode  with  the  midline 
parietal  electrode  were  greater  in  the  no¬ 
move  task  (P  <  5  x  10"*)  (Fig.  2C). 

The  right  parietal  locus  of  between- 
task  difference  in  the  P300  interval  may 
reflect  a  lateralization  of  activity  distin¬ 
guishing  the  two  types  of  spatial  judg¬ 
ment  (21)  or  the  difference  between 
movement  estimation  in  the  move  task 
and  the  cancellation  of  response  in  the 
no-move  task.  The  left  central  focus  of 
difference  in  the  RP  interval  135  msec 
later  may  reflect  the  preparation  and 
initiation  of  the  movement  of  the  right 
index  finger.  In  contrast,  the  pattern  of 
difference  in  the  N 1 00-P200  interval  was 
not  lateraHzed. 

These  results  may  help  explain  con- 
flictingrepom  of  brain  - potential  Isterali- 
zation.  In  many  studies,  various  “ver¬ 
bal-analytic"  and  “spatW”  tasks  1  min¬ 
ute  or  more  in  duration  have  been  associ¬ 
ated  with  relative  left  and  right  hemi¬ 
sphere  EEC  activity  (1-6).  However,  it 


Fig.  1.  (A)  Montage  of 
15  electrodes.  Non¬ 
standard  placements 
arc  intended  to  over- 
lie  cortical  areas  of 


tenor  occipital  (Oy). 
anterior  parietal  (pj). 


(superior  edge-Cr), 
and  midline  premotor 
(Cm)  areas.  (B)  Com- 


potcntiaJi 
(EWt)  bom  four 
persons  (75  percent  of 
the  total  data  from 
nine  persons)  for  the 
Pz  electrode,  showing 
the  ntjot  ERP  peaks 


Move  tsio  Mata) 

S 

p*  ; 


single  trial  correlation 
analysts  intervals. 

The  MOO  ERP  peak  is 
larger  m  the  infre¬ 
quent  no-move  trials. 

(O  One  of  the  15  sets  of  ten  electrode  pairs  into  which  the  91  paired  correlations  were  grouped. 
The  anterior  occipital  (Oy)  set  is  shown.  In  Fig.  2  the  principal  electrodes  of  differing  sets  are 
circled  and  the  most  prominent  correlations  are  indicated  is  solid  and  dotted  lines. 


N100-P200  Interval: 
149  to  324  msec 


P300  interval: 
302  to  477  meec 


RP  Interval: 
439  to  911  meec 


Fig.  2.  Diagrams  of  between- task  differences  in  the  tA)  NI0O-P2OO,  (B)  P300.  and  (C)  RP 
intervals  generated  by  neurocogmtive  pattern  (NCP)  analysis.  The  most  significantly  differing 
electrode  sea.  their  significance  level,  sad  the  most  prominent  correlations  within  the  set  are 
shown.  A  solid  line  between  two  electrodes  indicates  that  the  correlation  were  higher  in  the 
move  task,  while  a  dotted  line  indicates  higher  no-move  task  correlations. 
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is  not  clear  whether  this  activity  is  asso¬ 
ciated  with  mental  aspects  of  tasks  or 
with  sensorimotor  components,  or  with 
artifacts.  In  a  previous  study  we  found 
no  topographic  differences  in  EEC  spec¬ 
tra  between  15-second  arithmetic,  block 
rotation  and  letter  substitution  tasks  af¬ 
ter  rigorously  controlling  other-than-cog- 
nitive  factors  (2-4).  However,  such  het¬ 
erogeneous  tasks  cannot  be  resolved  into 
serial  components  reflecting  different 
neurocognitive  processes.  We  therefore 
refined  our  approach  by  using  short  (less 
than  1  second)  tasks,  using  time  refer¬ 
ences  based  on  person-specific  average 
ERP  measurements,  computing  correla¬ 
tions  between  channels  on  a  single-trial 
basis,  and  using  mathematical  pattern 
classification  to  reveal  split-second  se¬ 
quential  processing.  This  yielded  a  se¬ 
quence  of  clear-cut  between-task  differ¬ 
ence  patterns  involving  split-second 
changes  in  the  localization  and  lateraliza¬ 
tion  of  mass  neural  activity.  Appropriate 
studies  of  neurocognitive  functions 
should  take  into  account  this  rapidly 
shifting  network  of  localized  and  later- 
aiized  processes. 
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Section  £V 


NEUROCOGNITIVE  PATTERN  ANALYSIS  OF  A  VISUOMOTOR  TASK:  LOW-FREQUENCY 

EVOKED  CORRELATIONS 
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and  suggestions.  Thanks. 


29 


6BSIMCI 


Spatial  patterns  of  single-trial  evoked  correlations  of  huaan 
scalp-recorded  brain  potentials  were  detereined  by  applying 
Neurocognitive  Pattern  (NCP)  analysis  to  data  fro*  nine  adults 
perforaing  a  visuospatial  task.  Matheaatical  pattern  recognition  was 
used  to  determine  the  differences  in  the  spatial  patterns  of 
correlation  of  'eove*  and  •no-eove*  trials  in  successive  175-asec 
intervals.  The  magnitude  of  the  patterns  of  difference  between  tasks 
increased  in  each  successive  interval.  In  the  prestiaulus  interval, 
correlation  of  the  aidline  frontal  electrode  with  lateral  central  and 
left  teaporal  electrodes  was  greater  for  the  no-aove  task,  while  its 
correlation  with  the  left  parietal  electrode  was  greater  for  the  aove 
task  < p< » 01 ) .  In  the  interval  spanning  the  Nl.  P2  and  N2 

event-related  potential  (ERP)  peaks,  the  between-task  contrast  was 
focused  at  the  aidline  parietal  electrode  and  involved,  higher 
correlation  of  that  electrode  with  lateral  teaporal  and  aidline 
precentral  electrodes  in  the  aove  task,  and  with  the  left  frontal 
<F7)  electrode  in  the  no-aove  task  <p<.001>.  In  the  interval 
centered  on  the  P3a  peak,  the  focus  of  correlation  difference  was  at 
the  right  parietal  electrode  and  involved  higher  correlation  of  the 
right  parietal  with  occipital  and  aidline  precentral  electrodes  in 
the  no-aove_laskr  and  with  the  right  central  electrode  in  the  aove 
task  <p<5xl<J  ).  In  the  interval  centered  135  asec  after  the  P3a  ERP 
peak,  and  which  included  the  right-handed  response  preparation  and 
initiation,  the  aajor  focus  of  contrast  shifted  to  the  left  central 
electrode.  involving  higher  correlation  of  that  electrode  with 
aidline  frontal  and  occipital  electrodes  in  the  aove  task._gnd  with 
the  aidline  parietal  electrode  in  the  no-aove  task  <p<5xl0  ).  In 

seven  of  the  nine  participants .  the  group  equations  significantly 
distinguished  the  tasks.  Hove  and  no-aove  trials  which  were 
behaviorally  correct,  but  which  were  aisclassif ied  by  the  algoritha 
showed  high  prestiaulus  alpha  activity  in  the  averages,  and  had 
post-stiaulus  wavefora  aorphologies  interaediate  between  correctly 
classified  aove  and  no-aove  types.  Although  the  neurophysiological 
significance  of  these  patterns  of  evoked  correlation  is  unknown,  the 
results  are  consistent  with  the  observation  in  huaans  and  priaates 
that  siaple  visuospatial  tasks  involve  the  integration  of 
spatially-distributed  activity  in  aany  neural  areas. 


Neurocognitive  Pattern  '(NCP)  analysis  is  a  method  of  measuring  the 
functional  topography  of  human  scalp-recorded  brain  potentials  during 
goal  directed  activity*  It  involves  application  of  mathematical 
pattern  recognition  to  Measures  of  inter-electrode  correlations  of 
single-trial  evoked  brain  potentials*  Here  we  report  the  measurement 
of  rapidly  shifting*  focal  patterns  of  correlation  which  distinguish 
two  variants  of  a  brief  * aove/no-aove *  visuospatial  task. 

It  has  been  proposed  that  task-specific  neural  processes  Manifest 
patterns  of  waveshape  siailarity  (crosscorrelation)  of  low-frequency 
aacropotentials  (Dumenko*  1970*  Livanov*  1977).  A  number  of  studies 
have  approached  this  issue  with  scalp-recorded  EEGs  (Halter  and 
Shipton*  1951*  Brazier  and  Casby*  1952*  Callaway  and  Harris*  1974* 
Busk  and  Galbraith*  1975*  Livanov*  1977)*  but  this  hypothesis  remains 
unproven  due  to  problems  of  experimental  design  and  lack  of 
methodology  for  precise  measurement  of  task-related  correlation 
patterns  at  the  scalp. 

Any  test  of  the  hypothesis  thet  waveshape  siailarity  aaong 
scalp-recorded  brain  potentials  reflects  task-related  processing  in 
underlying  neural  populations  must  meet  several  methodological 
criteria.  First*  the  functional  relationships  of  specific  areas  must 
be  explicitly  manipulated.  Hell  established  'landmarks*  such  as 
sensory*  'association*  and  motor  areas  must  be  used  as  anatomic 
reference  points  in  the  experimental  design*  and  the  scalp 
projections  of  the  presumed  generators  must  be  considered.  Second* 
the  experiment  must  be  rigorously  controlled  for  stimulus*  cognitive* 
performance  and  response-related  factors  to  allow  unambiguous 
association  of  experimental  manipulations  with  spatiotempor al 
electrical  patterns.  Third*  a  high  degree  of  temporal  resolution  is 
required*  since  the  neural  processes  involved  in  brief  cognitive 
tasks  last  only  a  fraction  of  a  second.  Fourth*  measures  must  be 
made  on  single-trial  EEG  timeseries  rather  than  averages*  since  the 
exact  timing  of  neurocognitive  processes  may  vary  from  trial  to 
trial.  Fifth*  the  analytic  method  must  be  able  to  extract  small 
task-related  signals  from  the  obscuring  effects  of  background 
activity  and  volume  conduction. 

Our  first  study  employing  NCP  analysis  (Cevins*  et  al*  1981)  revealed 
complex*  rapidly  changing  patterns  of  evoked  correlation  which 
involved  many  areas  of  both  hemispheres  which  differed  between 
numeric  and  spatial  judgments  performed  on  equivalent  stimuli. 
However*  the  complex  patterns  were  difficult  to  interpret  since  the 
sequencing  of  neurocognitive  activity  in  numeric  and  spatial 
judgments  is  not  definitively  known.  The  present  study  was  designed 
to  clarify  this  situation  by  highlighting  presumably  localized  neural 
processes.  In  comparing  the  move  and  no-move  variants  of  a  spatial 
judgment  task  the  common  activity  of  brain  areas  should  cancel* 
revealing  focal  differences  in  visual  and  parietal  areas  presumed  to 
mediate  visual  discrimination  and  spatial  judgments.  The 


right-handed  response  in  the  ’aove*  task  should  elicit  lateralized 
activity  of  the  left  central  aotor  area. 

METHODS 


Tasks  and  Protocol 

The  participant  (P)  was  seated  in  an  acoustically  dampened  recording 
chaaber  with  right-hand  index  finger  resting  on  a  force  transducer. 
Stiauli  were  presented  on  a  Tektronix  graphics  terainal  and  subtended 
a  visual  angle  of  less  than  2  degrees  horizontally  and  vertically. 
They  consisted  of  an  arrow  originating  at  center  screen  and  a 
vertical  line  segaent  (the  ’target*)  to  one  side  (Fig.  1).  The 
target's  vertical  position  and  side  of  screen  changed  randoaly  across 
both  aove  and  no-aove  trials*  as  did  the  angle  and  direction  of  the 
arrow.  The  arrow's  angle  varied  froa  0  to  30  degrees  froa  the 
horizontal*  and  target  size  ranged  froa  2  to  36  aa  (see  below). 
Stiauli  reaained  on  the  screen  until  feedback  was  presented.  On  aove 
trials  the  participant  was  to  estiaate  the  distance  the  target  aust 
be  aoved  so  that  the  arrow's  trajectory  would  intersect  its  center* 
and  apply  a  pressure  proportional  to  that  distance  with  a  ballistic 
contraction  of  the  right  index  finger.  Responses  were  aade  on  a 
Grass  isoaetric  force  transducer  with  aaxiaua  laa  travel  at  a  force 
rate  of  1  kg/aa.  The  required  force  varied  randoaly  froa  .1  to  1  kg. 
On  *no-aove'  trials  the  arrow  and  target  were  oriented  so  that  the 
arrow's  trajectory  would  intersect  the  center  of  the  target*  and  no 
aoveaent  was  to  be  aade  (Fig.  1). 

Trials  occurred  in  blacks  of  13  or  17.  The  blocks  were 
self-initiated  by  the  participant  and  lasted  about  1.5  ain.  The 
no-aove  trials  constituted  ZOX  of  the  total  nuaber  of  trials  and  were 
presented  in  seai-randoa  order  such  that  the  first  two  trials  of  a 
block  were  always  aove  trials*  and  a  no-aove  trial  was  always 
followed  by  a  aove  trial.  Each  trial  consisted  of  a  warning  syabol 
followed  after  .2  sec  by  the  stiaulus.  One  second  after  coapletion  of 
response  in  the  aove  task*  feedback  indicating  the  response  pressure 
was  presented  for  1  sec.  Feedback  for  no-aove  trials  was  presented 
3.5  sec.  post-stiaulus.  The  inter-trial  interval  was  1.8  sec. 

Two  factors  were  included  to  reduce  the  autoaatization  of  task 
perforaance.  First*  at  the  start  of  each  block  of  trials  the  gain  of 
the  response  transducer  was  switched  between  2  levels  of  sensitivity* 
requiring  the  participant  to  adjust  his  responses  between  2 
pressure/distance  scales.  Second*  the  target  autoeatically  shrank  or 
lengthened  (froa  2  to  36  aa)  for  both  aove  and  no-aove  trials  as  an 
on-line  function  of  accuracy  in  the  previous  5  aove  trials.  Thus  task 
difficulty  was  continually  adjusted  to  aatch  each  person's  current 
perforaance  level. 

RycQr'Jirifli 

Nine  right-handed  adults  (8H*  IF)  were  recorded.  The  first  five  were 
healthy  students  and  professionals*  ages  20  to  35*  who  received  about 
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50  practice  trials  before  perforaing  the  tasks  during  2*5  hour 
recording  sessions*  The  last  four  were  highly  skilled  aircraft 
pilots  who  had  several  hundred  practice  trials  and  who  performed  a 
large  nuaber  of  trials  in  6  hour  recording  sessions* 

Brain  potentials  were  recorded  froa  15  scalp  electrodes  and 
referenced  to  linked  aastoids  (Fig*  2a).  The  aontage  included 
several  non-standard  aidline  placeaents  intended  to  overlie  cortical 
areas  of  particular  interest*  *a0z'  (anterior  occipital) *  *aPz* 
(anterior  parietal)*  *aCz*  (precentral ) *  and  *pFz*  (anterior  aotor). 
The  first  five  Ps‘  brain  potentials  were  aaplified  by  two  Beckaan 
Accutraces  with  .16  to  50  Hz  passband)  for  the  other  four  a 
Bioelectric  Systeas  Model  AS-64P  aaplifier  with  *10  to  50  Hz  passband 
was  use#.  Vertical  and  horizontal  eye-aoveaent  potentials 
(electrodes  at  outer  canthi  and  above  and  below  one  orbit) * 
response-auscle  potentials  (flexor  dioitorua) *  and  response 
transducer  output  were  aaplified  by  a  Grass  Model  6  with  .30  to  70  Hz 
passband.  All  signals  were  low-pass  filtered  at  50  Hz  (40  dB/octave 
rolloff)  and  digitized  to  11  bits  at  128  saaples/sec. 

Software  Svstea 

The  A0IEEG *  integrated  software  systea*  was  used  for  all  aspects  or 
the  experiaent  (Gevins  and  Yeager*  1972.  Gevins*  et  air  1975*  1979a* 
1981  *  l'983b).  This  systea  perforas  real-tiae  control  of  experiaents 
and  behavioral  and  physiological  data  collection)  allows  autoaatic 
on-line  aodification  of  experiaental  paraaeters  as  a  function  of  task 
perforaance)  has  a  flexible  database  structure  and  integrated  data 
path  for  the  recording  and  analysis  of  up  to  56  physiological 
channels)  allows  selection  and  control  of  the  stiaulus*  response  and 
per foraance-related  variables  used  to  aggregate  trials  into  data 
sets)  performs  digital  filtering  and  tiaeseries  analysis  of  EEGs  and 
ERPs)  and  tests  hypotheses  with  linear  univariate  and  eultivariate 
analyses  and  aatheaatical  pattern  recognition. 

Foreation  gf  Data  Sets 

Polygraph  records  were  edited  off-line  to  eliainate  trials  with 
evidence  of  eye  aoveaent  in  the  E0G  channels*  or  auscle  or 
instrueental  artifacts  in  the  EEG  channels*  froa  0.5  sec  before  the 
stiaulus  to  0.5  sec  after  response  initiation.  The  total  set  of  1612 
trials  (839  aove*  77 3  no-aove)  subaitted  to  analysis  consisted  of  69 
to  350  behaviorally  correct  trials  froa  each  of  the  9  participants 
(Table  1).  Correct  aove  trials  were  those  in  which  the  participant's 
response  was  ballistic*  was  coapleted  by  1.5  sec  after  stiaulus 
onset*  and  was  not  greatly  ’off  target*.  Correct  no-aove  trials 
were  those  in  which  no  EMC  was  evident  in  response  to  the  'no-aove* 
stiaulus  configurations.  There  was  no  difference  between  the  two  data 
sets  in  the  stiaulus  paraaeters  of  arrow  angle  and  side  of  screen  of 
the  arrow  and  target*  since  these  paraaeters  were  randoaized  by  the 
prograa.  Target  size  was  balanced  between  aove  and  no-aove  trials. 
The  set  of  aove  trials  had  representative  distributions  of  response 
variables  including  response  initiation  tiae*  accuracy*  pressure* 
duration*  and  velocity.  Response  initiation  was  deterained  by  the 
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baginning  of  the  avaraga  EMG  burst  of  tha  right  index  fingar's  flexor 
digitorua.  Thus  aove  and  no-aove  tasks  differed  slightly  in 
expectancy  and  stimulus  configuration*  differed  in  the  decision  based 
on  spatial  judgaent*  and  differed  greatly  in  type  and  difficulty  of 
response  . 

Average  ERPs 

Average  ERPs  for  all  channels  were  coaputed  for  each  person  in  order 
to  deteraine  centerpoints  of  tiae  intervals  for  NCP  analysis* 
Amplitudes  of  the  aajor  ERP  peaks  were  aeasured  froa  a  500-asec 
prestiaulus  baseline*  N1  was  the  first  aajor  negative  deflection* 
aaxiaal  posteriorly*  P2  was  the  iaaediately  succeeding  positive 
deflection*  aaxiaal  at  the  anterior  parietal  electrode.  P3a  and  P3b 
were  the  first  and  second  positive  peaks  enhanced  in  the  infrequent 
no-aove  task  and  aaxiaal  at  parietal  electrodes.  The  iaaediately 
succeeding  negative  potential  shift  (in  the  aove  trials)  was  aeasured 
as  the  slope  of  a  straight  line  fitted  to  the  ERP  in  the  175-asec 
interval  centered  135  aseC  after  the  P3a  peak. 

Single  Evoked  Trial  Correlations 

After  applying  a  phase-preserving*  nonrecursive  digital  lowpass 
filter  <3  dB  aaplitude  point  at  12  Hz)  to  the  single-trial 
tiaeseries*  crosscorrelations  between  pairs  of  electrodes  were 
coaputed  according  to  the  formula. 

N  N  N 


N^XY-^X^'l 
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where  X  and  Y  are  the  saapled  voltages  of  channels  x  and  y  at  N  tiae 
points*  and  s  *  s  their  standard  deviations*  A  Fisher’s  z’ 
transf oraation  *was  ythen  applied  to  each  correlation  value. 
Correlations  were  coaputed  for  each  of  the  1612  trials  in  each  of  4 
analysis  intervals  for  ?1  of  the  105  possible  pairwise  coabinations 
of  electrodes  (Fig.  2b).  14  pairs  which  were  non-hoaologous  or 

closely  spaced  were  excluded  due  to  coaputational  liaitations. 

Since  the  aajor  ERP  peaks  indicate  the  average  latencies  of  distinct 
task-related  processes*  the  centerpoint  locations  of  three  of  the 
four  175  asec  analysis  intervals  were  deterained  froa  the  peak 
latencies  of  the  average  ERP  (Fig.  3).  This  was  done  separately  for 
each  person  to  account  for  individual  variations.  The  first  interval 
was  the  175  asec  epoch  preceding  the  stiaulus.  The  second  interval 
stradled  each  person’s  N1-P2  peak  coaplex*  and  the  third  was  centered 
on  the  P3a  peak*  which  was  the  first  positive  peak  to  show  a  between 
task  difference.  The  fourth  interval  was  centered  135  asec  after  the 
P3a  peak  and  spanned  a  portion  of  the  response  preparation  <RP)  in 
the  aove  trials  and  the  P3b  peak  in  the  no-aove  trials.  (An  NCP 
analysis  synchronized  to  the  aoveaent  onset  will  be  reported 

elsewhere) . 
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To  equalize  the  scale  of  correlation  values  across  people?  the  Fisher 
z ' -transformed  correlations  were  converted  to  standard  scores  within 
each  person's  data  in  each  interval  (x*0?  s=l>  and  then  .grouped 
across  people*  ANOVAs  and  t-tests  were  performed  on  the  single-trial 
correlations  to  determine  task-related  differences  observable  by 
linear  statistical  methods* 

Use  of  Mathematical  Pattern  Recognition  for  Soatiotempor al  Analysis 


The  analysis  of  between-task  differences  in  spatial  patterns  of 
evoked  correlation  was  performed  with  nonlinear? 

distribution-independent?  trainable  classification-network 

mathematical  pattern  recognition  (Viglione?  1970?  Gevins?  1980? 
Gevins?  et  al?  1979a?  1981?  1983ab)«  This  method  is  similar  in 
purpose  to  stepwise  discriminant  analysis?  but  uses  a  more 
sophisticated  algorithm  to  search  for  combinations  of  variables  which 
distinguish  the  data  of  two  conditions  of  an  experiment*  The  search 
is  conducted  on  a  task-labeled  portion  of  the  data?  called  the 
training  set?  and  then  the  extracted  patterns  of  difference 
(classif ication  equations)  are  verified  on  the  remaining  unlabeled 
data?  called  the  test  set.  If  these  classification  equations  can 
significantly  divide  the  test  set  into  the  two  conditions?  the 
extracted  patterns  can  be  said  to  have  intrinsic  validity. 

To  avoid  spurious  results?  the  sensitivity  of  this  method  requires 
that  the  experimental  conditions  be  highly  balanced  for  all  factors 
not  related  to  the  intended  manipulations  (Gevins  and  Schaffer?  1980? 
Gevins?  et  al?  1980?  1983b?  Gevins  1980?  19B3ab>?  and  that  the  ratio 
of  observations  to  variables  be  on  the  order  of  20  to  1  or  more.  The 
variables  submitted  to  analysis  should  be  grouped  (constrained) 
according  to  neuroanatomical  and  neurophysiological  criteria  so  that 
interpretable  results  may  be  obtained  (Gevins?  et  al?  1979ac?  1981? 
1983ab?  Gevins  1980).  In  this  study  temporal  constraints  consisted 
of  locating  the  analysis  intervals  according  to  the  major  peaks  of 
each  person's  average  ERP.  Anatomical  constraints  were  applied  by 
forming  sets  consisting  of  the  correlations  of  each  of  the  15  scalp 
electrodes  (called  a  principal  electrode)  with  10  other  electrodes 
(Fig.  2c).  (To  reduce  the  amount  of  computation?  A  of  the  14 
possible  pairings  were  excluded  from  each  set.  These  involved 
electrodes  adjacent  to  the  principal  electrode?  or  pairings  nearly 
redundant  with  others.)  Midline  sets  were  symmetrical?  and  lateral 
sets  were  mirror  images  of  each  other. 


Classification  equations .  A  separate  classification  equation  was 

computed  for  each  of  the  15  electrode  sets  in  each  analysis  interval 
for  each  task-labeled  training  set.  Each  classification  equation 
consisted  of  a  linear  combination  of  the  binary  decisions  of  1  to  6 
discriminant  functions.  Each  discriminant  function  consisted  of  a 
linear  combination  of  6  correlations  selected  by  the  algorithm  from 
the  10  electrode-pair  correlations  of  an  electrode  set. 
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A  recursive  procedure  was  used  to  develop  each  classif ication 
equation*  First*  15  discriminant  functions  were  computed  (this 
number  was  set  by  computer  limitations) *  and  the  best  was  retained  as 
a  binary  output  (move  or  no-move)  times  a  coefficient  weighted  for 
optimum  classification  performance  by  minimization  of  an  exponential 
loss  function*  This  process  was  repeated  6  times*  the  best 
discriminant  function  from  each  new  set  of  15  was  added  to  the 
evolving  classification  equation*  and  the  weights  assigned  to  each 
were  updated.  After  each  pass*  the  training  data  were  re-weighted 
inversely  to  the  classification  effectiveness  of  the  classification 
equation*  so  that  the  next  pass  would  concentrate  on  the  incorrectly 
classified  data*  In  this  way  a  classification  equation  which 
optimally  partitioned  the  training  data  set  into  move  and  no-move 
tasks  was  formed. 

Training  and  testing  (validation )  data  sets  *  The  data  set  of  1612 
trials  was  partitioned  into  3  non-overlapping  test  (validation)  sets. 
For  each  test  set*  the  remaining  two-thirds  pf  the  data  served  as  its 
training  set.  This  rotation  of  training  and  testing  sets  reduced 
sampling  error  due  to  test-set  selection. 

A  separate  classification  equation  was  formed  using  each  of  the  3 
training  sets.  Then  the  classification  accuracy  of  each  of  the  3 
equations  for  each  interval  was  measured  on  its  corresponding  test 
set*  and  the  average  test-set  classification  accuracy  was  determined. 

Significance  levels  classification.  Since  our  aim  was  to 

determine  task-related  spatioteeporal  patterns*  rather  than  to 
predict'  behavior*  the  analysis  was  constrained  to  facilitate  a 
neuroanatomically  and  neurophysiological ly  meaningful  interpretation. 
Thus  classification  accuracies  were  not  as  high  as  they  would  have 
been  without  constraints.  To  determine  the  significance  levels  of  the 
classification  accuracies  it  was  necessary  to  determine  a  baseline 
significance  level  and  safeguard  against  a  Type  1  error.  To  do  this* 
equations  were  formed  from  sets  of  randomly  task-labeled  data  for 
each  analysis  interval.  The  average  classification  accuracy  of  48 
such  random-labeled  studies  was  50.6Z*  with  a  standard  deviation  of 
1.1X,  This  could  have  occurred  by  chance  with  p».32*  according  to  the 
normal-curve  approximation  to  the  binomial  distribution.  Actual 
test-set  classif ication  accuracies  of«52.9X*  53.9X*_g4.9Z  and  55. 5% 
correspond  to  p<.01*  p<.001*  p<5  x  10  and  p<5  x  10  '  respectively. 

These  significance  levels  were  used  as  an  index  of  the  relative 
consistency  of  differences  between  move  and  no-move  tasks. 

Diagrams  gt  classification  equations .  In  order  to  illustrate  the 
strangest  between-task  differences*  diagrams  were  drawn  showing  the 
principal  electrode  and  the  electrode  pairings  which  contributed  most 
to  the  classification  function  for  the  most  significant  electrode  set 
in  each  interval.  These  'prominent*  evoked  correlations  were 
determined  by  applying  the  pattern  recognition  procedure  recursively 
to  the  most  significant  electrode  set.  Each  discriminant  function 
(combination  of  correlations)  whose  weight  was  more  than  0.1  times 
that  of  the  maximum  weighted  function  was  retained  on  each  pass. 
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Within  the  selected  discriminant  functions?  those  correlations  whose 
weight  was  more  than  .25  times  the  highest  weighted  correlation  were 
retained*  The  selected  correlations  were  weighted  by  the  number  of 
discriminant  functions  remaining  in  the  classification  equation?  and 
summed  over  the  3  test  sets*  The  5  highest  weighted  correlations 
were  then  input  to  the  pattern  classifier*  If  'test-set* 
classification  for  a  given  interval  was  still  significant  at  pC.Ol? 
the  entire  procedure  was  repeated  with  the  least  significant 
correlation  removed  until  a  classification  function  incorporating  a 
minimum  set  of  3  or  4  'prominent  correlations*  was  produced* 

8ESULI3 


Average  ERP  Description 

The  average  ERP  waveforms  from  Ps  *6-9  (Fig.  4)  consisted  of  a 
posteriorly  maximum  negative  peak  (N163)  and  a  centro-par ietally 
maximum  positive  peak  (P230)  in  both  tasks.  In  the  move  task  there 
were  parietally  maximum  positive  peaks  at  425  and  500  msec?  followed 
by  a  centrally  maximum?  left-lateral ized  negative-going  slow 
potential  shift.  In  the  no-move  task  a  positive  peak  was  observed  at 
391  msec?  maximal  at  the  anterior  parietal  electrode  (aPz>?  another 
at  425  msec  and  a  third  at  530  msec?  both  maximal  at  the  midline 
parietal  electrode  (Pz).  Subtraction  ERPs  (Fig.  5)  showed  that  the 
P391  peak  in  the  infrequent  no-move  task  immediately  follows  a 
negative  peak  (N2)  at  240  msec?  and  thus  may  be  the  probability 
sensitive  P3a  peak  (Squires?  et  al?  1977).  The  larger  amplitude  of 
P425  in  the  move  task  may  be  due  to  the  atypical  experimental 
paradigm?  in  which  a  difficult  response  is  required  to  the  f reeuent 
task-related  stimuli.  P530  in  the  infrequent  no-move  task  may 
correspond  to  the  P3b  peak  observed  in  go/no-go  paradigms  and  to 
infrequent  task-related  stimuli.  Peak  latencies?  the  corresponding 
NCP  analysis  intervals?  and  response  initiation  times  for  each  person 
are  given  in  Table  1. 

ANOVAs  and  t-tests  were  performed  for  the  P391  (P3a)  peak  amplitude 
and  the  slope  of  the  immediately  succeeding  slow  negative  potential 
shift.  For  the  P391  peak?  a  task  x  electrode  x  person  ANOVA  revealed 
a  significant  task  effect  (F(l?8>  «  29.0?  p<<.001)  and  task  x 
electrode  interaction  (F(13?104)  *  2.9?  p<.005>?  but  no  electrode 
.  effect  (F(13?104>  =  1.2?  N.S.).  Correlated  t-tests  revealed 

significant  voltage  enhancements  in  the  no-move  task  for  all  but  the 
lateral  temporal  electrodes?  the  most  significant  effect  being  at  the 
«j  midline  anterior  parietal  electrode  (aPz>  (p<.0005>  (Table  2).  When 

Bonfer roni-cor r ected  for  multiple  comparisons?  only  the  aPz?  Pz  and 
»  C4  electrodes  remained  significant  (J  *  4.35  for  p<«05).  Mean 

amplitudes  across  persons  at  aPz  were  .1  uV  and  2.3  uV  for  move  and 
no-move  tasks?  respectively. 

A  task  x  electrode  x  person  ANOVA  of  the  slope  of  a  straight  line 
fitted  to  the  slow  potential  shift  in  the  response  preparation  (RP) 
interval  revealed  a  significant  task  effect  (F(l?8>  ■  5.6?  p<*05)? 
electrode  effect  (F(14?112)  *  1.9?  p<.05>?  and  task  x  electrode 
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interaction  (F(14>  112)  ■  2.7#  p<.005).  Correlated  t-tests  showed 
significantly  larger  eove-task  slopes  for  9  electrodes  (Table  3). 
The  aost  significant  difference  (p<*005>  was  at  the  C3  electrode# 
where  the  aean  slope  values  were  .24  and  -.50  for  aove  and  no-eove 
tasks#  respectively.  When  Bonf er r oni-cor rected  for  aultiple 
conparisons#  no  electrode  reaained  significant  (t  *  4.35  for  p<.05>. 

Linear  Analysis  &f  Evoked  Correlations 

Hean  evoked  correlation  values  over  persons  and  electrode  pairs  were# 
for  the  aove  trials!  prestiaulus  interval  *  .64#  N1-P2  interval  * 
.65#  P3a  interval  *  .65#  RP  interval  ■  .65#  and  for  the  no-eove 
trials!  prestiaulus  *  .65#  N1-P2  *  .65#  P3a  ■  .65#  and  RP  •  .64. 
t-tests  of  differences  in  single-trial  correlations  between  tasks 
were  perforaed  for  the  91  electrode-pair  correlations  (Table  4).  When 
Bonf erroni-cor rected  for  aultiple  coaparisons  only  the  F7-T3  and 
F8-Pz  pairs  in  the  RP  interval  reached  significance  (t*  3.58  for 
P<.05)«  Without  Bonferroni  correction#  correlations  significant  at 
P<.05  or  better  were  found  in  every  interval.  In  the  prestiaulus 
interval  5  of  the  9  significant  electrode  pairs  included  the  Fz 
electrode.  In  the  N1-P2  interval  the  4  significant  pairs  all  included 
parietal  sites.  In  the  P3a  interval  the  6  significant  pairs  were 
f ronto-central »  with  the  exception  of  the  P4-C4  pair.  In  the  RP 
interval  the  25  significant  pairs  were  widely  distributed#  but  8 
included  Fz#  9  included  F8#  and  5  included  C3. 

Pattern  Recognition  Analysis  gJT  Single-Trial  5v<?Kttf  Cffrrtl.gU-QP* 

Pattern  recognition  analysis  revealed  patterns  of  difference  in 
evoked  correlation  which  increased  in  eagnitude  in  each  successive 
interval.  The  principal  electrode  and  prominent  correlations  of  the 
•ost  significant  electrode  set  in  each  interval  are  shown  in  Figure 
6.  In  the  prestiaulus  interval  there  was  a  weak  between-task 
difference  of  the  Fz  electrode  set  (p<.01>#  involving  higher 
proainent  correlations  of  Fz  with  P3  in  the  aove  task  and  higher 
correlations  of  Fz  with  T3#  C3  and  C4  in  the  no-aove  task. 

In  the  N1-P2  interval  the  distinguishing  significant  difference  was 
in  the  Pz  electrode  set  (p<.001)»  with  higher  correlations  of  Pz  with 
aCz#  T3  and  T4  in  the  aove  task#  and  higher  correlations  of  Pz  with 
F7  in  the  no-aove  task. 

In  the  P3a  interval  the  aost  significant  difference  was  in  the  P4 
electrode  set  (p<5  x  10~  >»  with  higher  correlations  of  P4  with  C4  in 
the  aove  task#  and  higher  correlations  of  P4  with  aCz  and  aOz  in  the 
no-aove  task.  At  the  p<.001  level  the  aOz  electrode  set  also 
distinguished  the  tasks. 

In  the  RP  interval  theaost  significant  difference  was  in  the  C3 
electrode  set  (p<5  x  10  °)»  with  higher  correlations  of  C3  with  Fz 
and  aOz  in  the  aove  task#  and  higher  correlations  of  C3  with  Pz  in 
the  no-aove  task.  Four  other  electrode  sets  distinguished  the  tasks 
at  » lower  significance  levels!  C4  (p<l  x  10  >»  F7  and  T3  (p<5  x 

10  )»  and  Pz  (pC.001). 
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For  the  prestimulus  and  N1-P2  intervals  the  reduced  classification 
functions  required  4  'prominent  correlations’  to  achieve  significant 
classif ication;  while  in  the  P3a  and  RP  intervals  only  3  were  needed. 
Further;  significant  classification  (p<»05>  could  be  achieved  with 
just  the  first  ter*  (discriminant  function)  of  the  reduced 
classification  equation  (Table  5). 

To  test  the  interperson  validity  of  the  results;  the  classification 
accuracies  of  the  classification  equations  for  the  P4  electrode  set 
in  the  P3a  interval  and  the  C3  set  in  the  RP  interval  were  assessed 
on  the  data  of  each  person  individually;  and  compared  with  the 
overall  classification  accuracy  (Table  6).  The  group  equations  were 
valid  for  7  of  the  9  people.  As  a  further  test;  the  entire  analysis 
was  performed  on  the  data  of  one  person  (255  trials  from  P  #7)  for 
the  P3a  interval.  The  P4  electrode  set_ggain  achieved  the  highest 
classification  accuracy  (59. 4%;  p<5  x  10  J). 

DISCUSSION 

Neurophysiological  Significance  at  Task-Related  Evoked  Correlations 

In  theory;  a  task-related  difference  in  evoked  correlation  between 
two  scalp  electrodes  could  be  due  to  one  or  more  possible  causes:  1) 
functional  coordination  of  two  distinct  cortical  populations;  2) 
driving  by  a  third  cortical  or  subcortical  neural  area;  and  3) 
volume  conducted  activity  from  a  distant  generator.  While  it  is 
if  the  task-related  patterns  of  evoked  correlation  determined  by 
Neurocogniti ve  Pattern  (NCP)  analysis  reflect  functional  coordination 
between  cortical  (and  possibly  subcortical)  areas;  their  anatomical 
and  temporal  specificity  suggests  that  significant  aspects  of 
task-related  neural  processes  are  being  measured.  (A  preliminary  NCP 
Analysis  of  single  channel  signal  power  determined  significant;  but 
weaker;  between-task  patterns  of  difference.  Some  of  the  significant 
electrodes  corresponded  to  those  found  with  correlation  measures. 
These  results  will  be  reported  elsewhere.)  However;  the  significance 
of  waveshape  similarity  in  scalp-recorded  brain  potentials  will  not 
be  understood  until  further  studies  are  completed. 

NCP  An j 6,8E,i  and  N^yr Qppyghfflftfly 

In  this  section  the  main  NCP  results  will  be  discussed  in  light  of 
previous  neuropsychological  and  electr ophysiological  (ERP)  findings; 
showing  how  they  concur  with  and  elaborate  the  information  obtainable 
by  those  methods.  Psychological  interpretation  of  these  results  must 
be  considered  speculative;  since  the  processing  stages  involved  in 
the  task  are  not  definitively  known. 


The  magnitude  of  between-task  difference  increased  from  interval  to 
interval.  The  presence  of  a  small  significant  effect  in  the 
prestimulus  interval  might  be  the  result  of  a  weak  task-specific 
preparatory  set  generated  in  the  course  of  the  session  by  the 
ordering  of  move  and  no-move  trials.  The  locus  of  this  difference  in 
the  Fz  electrode  set  is  consistent  with  neuropsychological  and 


electrophysiological  (CNV)  findings  suggesting  involveaent  of 
prefrontal  cortex  in  preparatory  activity  (Teuber?  1964?  Walter? 
1967?  Foster?  1980).  A  previous  NCP  study  (Gevins?  et  air  1981)  also 
revealed  evidence  of  a  task-specific  preparatory  set  in  the  task-cued 
prestieulus  interval  preceding  nueeric  and  spatial  judgeents.  The 
proninent  correlations  of  Fz  with  T3r  C3r  C4  and  P3  in  the  present 
study  suggest  that  this  preparatory  activity  extends  beyond 
prefrontal  areas. 

In  the  N1-P2  interval?  correlations  of  the  Pz  electrode  set 
distinguished  eove  and  no-eove  tasks  at  pC.OOl.  Subtraction  ERPs 
revealed  an  enhanceeent  of  the  N2  peak  no-eove  trials  in  6  of  the  9 
participants  (792  of  the  total  data  set)  (Fig.  5).  Its  aean  latency 
of  240  esec.  placed  it  near  the  center  of  the  N1-P2  analysis 
interval?  and  its  aaplitude  was  eaxiaal  (1.7  uv)  at  Pz.  Thus  the 
between-task  correlation  differences  in  this  interval  aay  be  related 
to  N2 .  Although  an  aaplitude  increase  in  the  N2  peak  in  no-go  trials 
of  a  go/no-go  paradiga  with  equiprobable  conditions  has  been  reported 
(Siason?  et  al?  1977)?  N2  has  usually  been  reported  to  be  sensitive 
to  infrequent  changes  in  gross  stiaulus  properties  or  patterns 
(Naatanen?  et  al?  1980).  However?  in  the  present  study?  stiauli  were 
equivalent  between  conditions  in  all  respects?  save  that  in  no-aove 
trials  the  arrow  pointed  directly  at  the  target  in  various 
r andoaly-ordered  configurations.  The  N2  effect  at  240  asec  suggests 
that  a  no-aove  configuration  has  been  identified  by  that  tiae?  and 
that  HZ  aay  reflect  a  aore  subtle  process  than  the  detection  of  a 
gross  'aisaatch*  in  stiaulus  characteristics?  as  indicated  by  other 
recent  studies  (Ritter?  et  al?  1982).  The  proainent  correlations  of 
Pz  with  T3?  F7 ?  aCz?  and  T4  suggest  that  these  processes  are  not 
confined  to  the  parietal  area. 

In  the  P3a  interval  (which  was  centered  on  the  P3a  peak  and 
overlapped  a  portion  of  the  P3b  peak)_the  right  parietal  (P4)  locus 
of  correlation  differences  (p<5  x  to”3)  provides  novel  evidence  for 
the  lateralization  of  neural  processes  related  to  these  late  positive 
ERP  peaks.  Although  on  the  basis  of  lesion  evidence?  the  right 
parietal  cortex  is  known  to  be  necessary  for  such  spatial  judgeents? 
the  late  positive  ERP  peaks  have  not  been  found  to  vary  in 
lateralization  according  to  type  of  cognitive  task  (Donchin?  et  al? 
1977).  J»  Oesaedt  (1977)  reported  a  relative  right-sided 
lateralization  in  the  ERP  in  a  spatial  soeatosensory-eotor  task?  but 
the  effect  was  general  and  was  not  present  in  the  P3  peak?  nor  was 
its  scalp  distribution  detereined.  A  previous  NCP  study  (Gevins?  et 
al?  1981)  deaonstrated  lateralized  teeporo-par ietal  evoked 
correlation  differences  between  nueeric  and  spatial  judgeents  in  the 
interval  centered  on  the  P3a  peak  at  340  esec.?  but  the  interval 
centered  on  the  P3b  peak  at  450  esec.  exhibited  bilateral 
between-task  differences  froe  frontal?  central?  and  parietal 
electrodes.  In  the  present  study?  the  between-task  differences  in 
correlations  of  the  right  parietal  electrode  with  central  and 
occipital  electrodes  is  in  accord  with  neuropsychological 
expectations?  as  is  the  soeewhat  weaker  effect  in  the  eOz  electrode 
set.  The  lateralized  NCP  finding  is  in  contrast  with  the  anterior 
eidline  parietal  (aPz)  locus  of  eaxiaal  aaplitude  difference  of  the 


P3a  ERF  peak. 


In  the  response  preparation  <RP>  interval*  centered  135  nsec  after 
the  P3a  interval  centerpoint*  the  focus  of  between-task  difference 
shifted  to  the  left  central  <C3)  electrode  set  <p<5  x  10  >» 

involving  higher  correlations  of  C3  with  Fz  and  aOz  in  the  move  task 
and  with  Pz  in  the  no-eove  task.  Since  the  RP  interval  overlapped 
EMG  onset  in  a  portion  of  the  set  of  »ove  trials  (average  response 
tine  *  590  msec*  Mean  S.D.  within  persons  *  240  Msec.)*  the  RP 

interval  results  May  also  include  a  contribution  froe  the  output 
activity  of  Motor  cortex.  The  C4*  F7*  and  T3  electrode  sets*  which 
differed  at  lower  significance  levels*  May  also  reflect  movement 
preparation  and  initiation*  since  the  presumed  generators  of 
voluntary  finger  Movements  are  buried  in  the  lateral  bank  of  the 
central  sulcus  and  their  scalp  projection  may  be  diffuse.  The  less 
significant  difference  in  the  Pz  electrode  set  May  reflect  concurrent 
processes  related  to  P3b. 


ihjfti.ng  Lateralization 


The  rapid  <135  msec)  shift  in  side  and  site  of  lateralization  from 
the  P3a  to  the  RP  interval  may  help  clarify  the  controversy 
surrounding  the  existence  of  lateralization  of  brain  potentials  in 
different  types  of  cognitive  activity.  Although  various 
'verbal-analytic*  and  'spatial*  tasks  lasting  one  Minute  or  more  have 
been  associated  with  relative  left  and  right  hemisphere  activity*  it 
is  not  clear  whether  this  is  due  to  cognitive  activity*  or  to 
stimulus*  motor*  or  arousal-related  aspects  of  the  tasks  (Donchin*  et 
al*  1977*  Gevins  and  Schaffer*  1980)  Gevins*  et  al*  1980*  Gevins* 
1983ab>.  In  an  earlier  study  (Gevins*  et  al*  1979abc)*  we  first 
found  prominent  spatial  differences*  including  lateralized  patterning 
of  EEG  spectra*  between  one  ainute  linguistic  and  spatial  tasks 
(reading  and  writing*  Koh's  Block  Design  and  mental  cube 
reconstruction).  However*  no  spatial  differences  in  EEG  spectra  were 
found  between  similar  15  second  tasks  which  were  more  controlled  for 
ather-than-cognitive  factors.  Since  heterogeneous  tasks  coaposed  of 
many  component  operations  cannot  be  clearly  resolved  into  serial 
processes*  our  subsequent  study  (Gevins*  et  al*  1981)  refined  the 
approach.  It  used  short  (less  than  1  second)  visuomotor  tasks 
'}  differing  only  in  type  of  judgment  (numeric  and  spatial)*  employed 

175-msec  analysis  intervals  based  on  person-specific  ERP 
measurements*  and  used  measures  of  between-channel  correlations  in 
single  trials  as  features  for  NCP  Analysis.  That  study  revealed  that 
even  split-second  judgments  involve  a  complex*  rapidly  shifting 
mosaic  of  task-related  evoked  correlation  patterns  involving  many 
electrodes  over  both  hemispheres.  Thus*  simplistic  views  of 
neurocognitive  processing  may  be  the  result  of  inadequate  temporal 
,  resolution  of  rapidly  changing  neural  activity. 

The  present  study  confirmed  this  by  comparing  move  and  no-move 
I  variants  of  the  same  spatial  task.  The  results  suggest  that  the  tasks 

|  involve  split-second  changes  in  the  relative  localization  and 
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lateralization  of  naural  activity.  A  dramatic  switching  of  tha  foci 
of  patterns  of  evoked  correlations  is  seen  as  the  stimulus  is 
anticipated'  perceived'  judged'  and  a  response  executed.  These 
rapidly  shifting  patterns  are  consistent  with  network  eodels  of 
higher  cognitive  functions  (Luria'  1977$  Arbib  and  Caplan'  1979$ 
Zurif  1980$  Hesulae'  1981$  and  Gevins'  1981'  1983b) •  It  should  be 
understood  that  the  simplicity  of  the  patterns  reported  (Figure  6)  is 
due  to  the  fact  that  only  the  eost  significant  results  were 
diagrammed.  The  inclusion  of  results  at  lower  significance  levels 
would  create  more  complex  patterns'  particularly  in  the  RP  interval. 
Further'  in  a  separate  within-task  analysis'  where  each  post-stimulus 
interval  was  compared  with  its  prestimulus  interval'  it  was  evident 
that  within-task  differences  were  complex  and  increased  in  magnitude 
and  anatomic  distribution  from  interval  to  interval.  This  is 
consistent  with  a  within-task  interlatency  analysis  reported 
previously  (Gevins'  et  alt  1981). 

Individual  Differences 

Although  the  classif ication  accuracies  of  the  overall  ( aultiperson ) 
classification  equations  assessed  on  the  data  of  the  individual 
participants  varied  appreciably  (Table  6)'  the  existence  of  some 
invariant  task-related  patterns  in  7  of  the  9  persons  was  confirmed. 
The  fact  that  the  significant  difference  between  tasks  was  also  found 
at  the  P4  electrode  set  in  the  P3a  interval  when  the  data  of 
one-person  was  subjected  to  NCP  analysis  also  supports  the  inference 
of  patterns  which  are  invariant  across  people.  Moreover'  a 
nonpar ametr ic  randomization  test  performed  on  the  individual 
classif ication  accuracies  of  the  two  groups  of  P’s  (*l-5  and  *6-9) 
confirmed  that  the  classification  equations  did  not  significantly 
differ  between  the  two  groups. 


15  S££  Vlffvl? 

Analytic  methodology  is  a  critical  factor  in  determining  the 
precision  and  relevance  of  results  in  brain  potential  studies.  NCP 
analysis  uses  modern  signal  processing  and  pattern  recognition 
technologies  to  distinguish  spatially  and  temporally  overlapping 
task-related  brain  potential  patterns.  It  builds  on  the  vast  body  of 
ERP  research  by  using  the  average  ERP  to  determine  person-specific 
time  intervals  during  which  successive  stages  of  task-related 
processing  may  be  assumed  to  occur.  It  then  searches  the 
single-trial,  multichannel  brain  potential  data  with  a  mathematical 
pattern  classif ication  algorithm  to  extract  spatial  patterns  which 
distinguish  the  two  conditions  of  an  experiment.  As  with  other 
advanced  approaches  (reviewed  in  McGillem.  et  al»  1981  and  Gevins 
1980)»  it  has  the  potential  to  reveal  information  not  obtainable  from 
averaged  waveforms.  Further  studies  will  determine  whether  NCP 
analysis  produces  results  meaningful  enough  to  justify  the  large 
amount  of  computation  required. 
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A  full  comparison  of  NCP  analysis  with  linear  multivariate  methods  is 
beyond  the  scope  of  this  paper.  Two  linear  tests  were  performed  to 
give  some  indication  of  the  differences  between  methodsi  post-hoc 
task  x  electrode-pair  ANOVAs  on  selected  variables*  and  the 
Bonferr oni-cor rected  t-tests  on  the  full  set  of  single-trial 
correlations.  The  ANOVAs  were  limited  to  the  10  correlations  of  the 
most  significant  electrode  sets  determined  NCP  analysis:  the  P4  set 
in  the  P3a  interval  and  the  C3  set  in  the  RP  interval.  Only  the 
electrode-pair  effect  reached  significance  (F(14*72>  *  57.9*  p<<.001 
and  F(14*72>  =  48.6*  p<<«001*  respectively ) .  There  was  no 

significant  task  main  effect  or  task  x  electrode-pair  interaction. 
This  result  and  the  results  of  the  t-tests  (Table  4)  suggest  that  the 
variable  subset  selection  and  the  nonlinear*  distribution-independent 
properties  of  the  NCP  Analysis  were  both  important.  This  is 
consistent  with  two  previous  studies  where  this  type  of  mathematical 
pattern  recognition  proved  more  effective  than  ANOVA  and  stepwise 
linear  discriminant  analysis  (Cevins*  et  al*  1979a*  Lieb*  et  al* 
1981).  Although  the  Bonf err oni-corr ected  t-tests  were  significant 
for  only  two  electrode  pairs  in  one  interval*  at  uncorrected 
significance  levels  <p<.05  or  better)*  the  significant  electrode 
pairs  did  show  a  slight  similarity  to  the  NCP  results.  Of  the 
significant  Fz  pairs  in  the  prestimulus  interval*  3  are  identical  to 
the  prominent  correlations  determined  by  NCP  Analysis  (Fz-C3*  Fz-C4 
and  Fz-T3),  and  the  frontal  distribution  of  significant  pairs  accords 
with  the  distinguishing  Fz  electrode  set  in  the  NCP  results.  For  the 
N1-P2  and  P3a  intervals*  however*  only  the  T4-Pz  electrode  pair  in 
the  former  interval  and  the  P4-C4  pair  in  the  latter  correspond  to 
prominent  evoked  correlations  of  the  NCP  analysis*  In  the  * 
interval  the  t-tests  were  focused  on  the  frontal  areas  and  included 
only  two  significant  pairs  from  the  NCP  results  <C3-Fz  and  C3-Pz). 


In  its  present  form*  NCP  Analysis  seems  able  to  extract  patterns  of 
task-related  evoked  differences  from  the  obscuring  effects  of  volume 
conduction  and  background  EEG.  Further  research  is  being  conducted 
using  measures  of  interchannel  timing  and  single  channel  power  in 
paradigms  involving  manipulation  of  modality  and  responding  hand. 
These  studies  may  help  elucidate  the  significance  of  inter-electrode 
evoked  correlations  accompanying  neur ocognitive  processes. 
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LEGENDS 


Figure  1  -  Examples  of  stimuli  for  move  and  no-move  trials.  Arrow 
originated  at  center  screen,  its  direction  and  the  location  of  the 
target  changed  randomly  across  trials.  The  labels  ‘Move*  and 
"No-Move"  did  not  appear  in  the  actual  stimuli. 

Figure  £A  -  Electrode  montage. 

Figure  2B  -  91  pairwise  correlations  were  computed  between  the  15 
electrodes . 

Figure  gC  -  Anatomical  constraints.  The  correlations  of  a  principal 
electrode  was  measured  with  10  other  electrodes.  The  aOz  electrode 
set  is  shown. 

Figure  3  -  The  major  peaks  of  the  average  event-related  potential 

(ERP)  and  Neurocognitive  Pattern  (NCP)  Analysis  intervals  determined 
from  them.  This  illustration  is  an  average  of  the  data  from  the  last 
four  persons  in  the  study,  in  practice,  the  peaks  and  analysis 
intervals  were  determined  separately  for  each  person. 

Figure  4a  -  ERPs  for  Move  trials  <610  trials  from  P's  #6-9). 

Figure  -  ERPs  for  No-Move  trials  <604  trials  from  P's  #6-9). 

Figure  5  -  Subtraction  ERP ' s  <No-Move  minus  Move.  6  P's)  showing  the 
negative  <N2)  peak  at  240  msec. 

Figure  $  -  Between-task  NCP  results  obtained  from  single  trial  evoked 
correlations.  The  most  significantly  differing  electrode  set  and  its 
prominent  correlations  are  shown  in  each  interval. 

Figure  7 a  -  Average  right  parietal  ERP  of  those  Move  trials  correctly 
classified  by  the  NCP  analysis  in  both  the  P3a  and  RP  intervals  using 
correlation  measures  <195  trials  from  4  people) • 

Figure  7J2  ~  Average  ERP  of  correctly  classified  No-Move  trials.  P391 
<P3a)  and  P530  <P3b)  peaks  are  larger  in  the  correctly  classified 
No-Move  trials  <193  trials  from  4  people). 

Figure  7c  -  Average  ERP  of  incorrectly  classified,  but  behaviorally 
correct.  Move  trials  <122  trials  from  4  people). 

Figure  7£  -  Average  ERP  of  incorrectly  classified,  but  behaviorally 
correct.  No-Move  trials.  P3a  is  absent  and  P3b  is  smaller,  thus 
resembling  the  correct  Move  ERP  <121  trials  from  4  people). 

Table  \  -  Number  of  trials.  ERP  peak  latencies,  centerpoints  of  the 
NCP  single  trial  correlation  analysis  intervals,  and  average  response 
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initiation  latency  (EHG  onset)  for  each  of  the  9  participants. 

Table  2  -  Averaged  P3a  peak  aaplitude  (in  eicro-volts)  and  correlated 
(-tests  (df  ■  9). 

Table  3  -  Response  Preparation  <RP)  interval*  averaged  slope  of  a 

straight  line  fitted  to  slow  negative  potential  shift  and  correlated 
(-tests  (df»9). 

Table  4  -  (-tests  of  correlations  for  the  nine  participants  (1612 

trials!  839  Hover  773  No-Hove)*  Only  those  channel  pairs  showing  a 
significant  uncorrected  (-value  are  listed*  (p<*05  ■  1.96*  p<*01  * 
2.57*  p<*001  *  3*29.  xBonfer roni-corrected  (-value  of  3*58  ■  p<*05.) 

Table  5  -  Siaplified*  single  discriainant  function  classification 

equation*  G(f)  *1  for  f>0»  else  G(f)  (X/Y)  is  the  standardized* 

Fisher's  z‘  transforeed  correlation  value  of  the  X-Y  electrode  pair. 
Individual  trials  whose  classification  function  G(f)  *  1  were 
assigned  to  the  no-eove  class*  those  whose  G(f)  *  0  to  the  eove 
class. 

Table  4  -  Classification  accuracy  for  the  P3a  and  RP  intervals  for 
each  of  the  9  participants  using  the  equations  derived  froe  the  whole 
group. 
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V.  SIGNAL  PROCESSING  STUDIES  (Also  Sponsored  by  the  Office  of  Naval 
Research  and  the  USAF  School  of  Aerospace  Medicine) 

A.  Introduction 

In  order  to  further  understand  the  signals  extracted  in  the 
move/no-move  visuospatial  experiment  (Sections  III  and  IV) *  we  are 
attempting  to  determine  which  type  of  measurements  and  frequency  bands 
have  the  most  specific  task-related  information.  Preliminary  results 
of  these  ongoing  studies  are  presented  in  this  section.  Me  began  by 
digitally  filtering  the  single-trial  brain  potential  timeseries  into 
five  passbands  determined  from  Fourier  analysis  of  each  person's 
average  ERPs.  This  was  based  on  the  strategy  that  mass  brain 
potentials  of  different  frequency  bands  might  have  different  types  of 
information.  This  resulted  in  separate  'delta1 *  "theta" *  and  low  and 
high  "alpha"*  and  "beta"  frequency  band  timeseries  for  each  person. 
Then*  using  brief  analysis  intervals  centered  at  latencies  determined 
from  the  peaks  of  each  person's  average  ERPs*  four  types  Of 
measurement  were  made  on  the  timeseries  of  each  frequency  band!  1) 
maximum  covariance  between  a  pair  of  channels*  Z)  lag-time  to  maximum 
covariance*  3)  shape  of  the  lagged  covariance  function*  and  4)  single 
channel  power.  These  measurements  were  then  used  as  features  in  a 
between-task  pattern  recognition  analysis*  and  the  relative 
classification  accuracy  obtained  with  each  measure  was  used  as  an 
index  of  its  usefulness. 

B.  ailiUUjg 

The  analysis  was  confined  to  the  data  of  the  last  four  of  the  original 
nine  people  (see  Table  I  in  Section  IV).  Three  of  the  four  were  Air 
Force  fighter  test  pilots*  while  the  fourth  was  formerly  a  transport 
pilot.  All  were  highly-trained  individuals  who  demonstrated  a 
professional  motivation  towards  the  experiment  and  produced  data  of 
superior  quality.  The  analysis  was  confined  to  the  time  windows  and 
channel  pairs  in  which  highly  significant  between-task  differences  in 
results  had  been  obtained  using  the  zero  lag  correlation  measure}  the 
three  right  parietal  (P4)  electrode-pairs  in  the  P3a  interval  and  the 
three  left  central  (C3)  electrode-pairs  in  the  response  preparation 
(RP)  interval  (see  Fig.  6  in  Section  IV). 

For  the  NCP  analysis  each  of  3  training  sets  contained  804  trials  and 
each  of  3  testing  sets  contained  40Z  trials  (total  trials  *  1206). 
Optimal  feature  subsets  were  selected  by  exhaustive  search.  Pattern 
classif ication  accuracy  was  the  average  of  the  performance  of  the 
equations  on  the  3  testing  data  sets.  The  classification  accuracy  for 
each  significance  level  is  shown  in  Table  4.  For  each  significant 
result*  terms  of  the  equation  having  weights  exceeding  a  threshold  of 
13%  of  the  maximum  weight  of  the  largest  term  were  selected  for 
display. 


i.  nmvrif 


Zero-lag  correlation  was  replaced  by  several  covariance-derived 
eeasures  to  detereine  whether  useful  information  was  discarded  in  the 
norealization  involved  in  the  correlation  measure*  The  entire 
covariance  function*  rather  than  just  the  zero-lag  value*  was 
considered  to  test  for  information  in  the  timing  of  the  ERPs  (Figures 
4  to  6).  Each  covariance  function  was  formed  by  lagging  the  signals 
*6  time  points  <48  msec).  Lag  values  were  computed  from  extended 
real  data  points*  rather  than  from  an  increasing  number  of  zeros  as 
done  in  the  noncyclic  fast  convolution  (FFT)  method* 

As  a  preliminary  step*  spectral  analysis  and  bandpass  filtering  were 
performed  on  the  averaged  ERP  for  each  person*  Three  non-overlapping 
FFT's  were  performed  for  the  0*5  second  prestimulus  and  two  0*5  second 
post-stimulus  windows  for  each  averaged  ERP  channel  for  each  person* 

A  histogram  was  formed  from  spectral  frequencies  over  each  channel 
(Figure  7)  and  used  to  determine  passband  widths  for  each  person* 
Unfiltered  average  ERPs  for  one  person  are  shown  in  Figure  8a* 
Filtered  ERPs*  with  passbands  selected  from  Figure  7*  are  shown  in 
Figures  8b-h. 

Covariance  was  computed  between  two  filtered  single  trials  *  X(t>  and 
Y(t)*  using  the  raw  score  method* 

N  N  N 

CXY(r)  "flEX<t)*t)  -  £  X(t)  EY(tJ/6* 

where  N  is  the  number  of  points  in  the  time  window*  Three  features 
were  derived  from  the  covariance  function*  The  first  was  the  maximum 
(absolute)  value  of  the  covariance  function*  The  second  was  the  lag 
time  at  the  peak  of  the  covariance  function*  employed  to  measure  the 
relative  timing  of  signals  between  channels*  Since  this  peak  lag 
measure  was  likely  to  be  unstable*  a  third  measure  was  used  to  assess 
inter-electrode  timing*  This  was  a  lagged  covariance  function  'shape 
measure**  computed  as  the  similarity  of  the  lagged  covariance  function 
to  a  cosine  function*  Since  the  cosine  is  an  even  function*  this 
measure  would  indicate  the  tendency  of  one  channel  in  a  pair  to  lead 
or  lag  the  other*  The  frequency  of  the  cosine  used  was  the  center 
frequency  of  the  passband  used  to  filter  the  ERP  forming  the 
covariance  function*  The  'shape  measure*  was  computed  as  the  sum  of 
cross-products  between  the  points  of  the  covariance  function  and  the 
cosine  function*  The  sum  was  divided  by  the  maximum  absolute 
cross-product  to  equalize  the  range  across  frequency  bands*  This 
measure  was  expected  to  be  more  stable  than  the  lag-to-peak  measure 
since  it  is  derived  from  all  points  in  the  covariance  function  rather 
than  just  one*  The  fourth  measure  was  single  channel  power*  computed 
as  the  mean  square  value  of  the  filtered  timeseries  over  the  points  of 
the  time  window* 

2.  Channels 

In  the  between-task  results  of  the  earlier  analysis  (Sections  III  and 
IV)  correlations  of  the  right  parietal  (P4)  electrode  distinguished 
the  move  vs  no-move  tasks  in  the  P3a  interval  with  greatest  accuracy* 


The  three  correlations  which  contributed  most  to  this  discr imination 
were  P4-a0z*  P4-C4*  and  P4-aCz.  Likewise  in  the  RP  interval»  C3-a0z * 
C3-Pz*  and  C3-Fz  were  aost  effective  in  distinguishing  the  tasks. 
Consequently  these  six  channel  pairs  were  used  in  the  present  study. 
In  the  P3a  interval*  the  C3  pairs  were  used  as  controls*  and  in  the  RP 
interval  the  P4  pairs  were  controls. 

Single  channel  power  was  coaputed  for  the  seven  channels  which  foraed 
these  pairs*  as  well  as  for  the  P3  electrode  to  preserve  syaaetry  in 
the  eight-channel  power  analysis. 

3 .  Time  intervals 

The  P3a  interval  was  deterained  individually  for  each  of  the  four 
people  so  that  it  straddled  the  P3a  component  of  each  individual's 
averaged  ERP.  The  RP  interval  was  centered  at  the  time  of  onset  of 
the  response*  as  measured  by  the  average  EHG  onset  for  each  person. 

The  width  of  the  analysis  intervals  varied  with  the  frequency  band  in 
order  to  accommodate  at  least  one  full  cycle  of  the  highest  frequency 
component  in  a  given  band.  For  reasons  of  stability  of  the  measures* 
100  msec  was  the  shortest  window  width.  For  the  delta  band  the 
windows  were  200  msec  wide*  for  the  theta  band  they  were  17S  msec*  and 
for  t.-e  three  higher  bands  they  were  100  msec. 

tach  single-trial  timeseries  was  separately  filtered  into  five 
fetuency  bands  before  other  computations  were  performed.  The  average 
banup«*s  settings  were  0-4  Hz  (delta)*  4-8  Hz  (theta)*  8-11  Hz  (low 
alpha)*  11-15  (high  alpha)*  and  15-22  Hz  (beta).  Exact  settings  were 
individually  set  for  each  person  based  on  Fourier  analysis  of  their 
averaged  ERPs.  Linear  phase*  Hamming  FIR  filters  were  employed.  They 
were  convolved  with  the  timeseries  by  a  fast  convolution  (via  FFT) 
using  the  overlap-save  method. 

C.  Refulty 

1 .  Crosscovariance  Measures 


Using  the  maximum  covariance  measure*  the  pattern  classification 
analysis  was  able  to  differentiate  the  two  tasks  ijji  t^e  P3a  interval 
using  the  P4  electrode-pair  covariances  (p<5  x  10  H)  Figure  9)*  but 
was  unable  to  do  so  using  the  C3  electrode-pair  (control)  covariances. 
The  algorithm  was  allowed  to  combine  frequency  bands  to  achieve 
optimum  classification.  The  major  features  which  it  used  were  from 
the  delta  and  theta  bands.  In  Figures  9  and  10*  a  solid  line 
connecting  two  electrode  sites  indicates  that  the  value  for  the  move 
task  was  greater*  a  dashed  line  that  it  was  greater  for  the  no-move 
task.  A  previous  analysis  in  this  interval*  using  the  .1-12  Hz  band* 
zero-lag  correlation  for  the  same  three  P4  electrode^pair s * 
discriminated  the  tasks  with  significance  of  only  1  x  10  .  Therefore 

greater  discrimination  was  achieved  by  definition  of  the  frequency 
range*  by  using  covariance  rather  than  correlation*  and  by  shifting 
the  time  series  in  time  to  find  their  maximum  covariance. 


In  the  RP  interval*  the  two  tasks  wars  successfully  classified  by  the 
C3  electrode-pair  covariances  (p<5  x  10  i  (Figure  9)*  but  not  the 
control  (P4)  electrode-pair  covariances*  Again  the  eajor  features 
were  froa  the  delta  and  theta  bands*  Although  this  classification 
significance  was  high*  it  was  below  that  of  the  previous  zero-lag 
correlation  study* 

The  lag-to-aaxieue  covariance  was  not  successful  in  significantly 
discriminating  tasks*  presumably  because  of  the  instability  of  this 
measure  without  thresholding* 

Using  the  shape  lagged  covariance  measure  in  the  P3a  interval*  the  P4 
pairs  classified  the  trials  (p<l  x  10  i  (Figure  10)*  whereas  the 
control  pairs  did  not.  Shape  measures  from  the  delta  and  beta  band 
were  the  major  ones  used*  In  the  RP  interval*  the  shape  measure  of 
the  C3  pairs  classified  the  trials  (p<10  ;*  but  the  controls  did  not. 

The  major  features  were  in  the  theta  band* 

2.  Single-Channel  Power  Measures 

For  the  power  measures*  P4*  C4  and  aOz  were  used  for  the  P3a  interval* 
P3*  C3  and  aOz  for  the  RP  interval*  In  the  P3a  interval  the 
algorithm  was  unable  to  discriminete  the  tasks  with  these  channels. 

In  the  RP  interval*  the  delta  band  was  used  to  discriminate  at  pC.OOl 
(Figure  11)  compared  to  p<*05  for  controls*  In  Figures  11  and  12*  an 
upward  arrow  indicates  that  the  move  task  power  was  greater*  a 
downward  arrow  that  no-move  power  was  greater. 

Another  analysis  was  performed  with  the  power  measure  from  eight 
channels.  Separate  analyses  were  performed  for  each  of  the  five 
frequency  bands  (Figure  12)* 

In  the^RP  interval  discrimination  was  achieved  in  the  delta  band  at 
P<lxl0  )*  using  channels  C3*  Pz*  aOz  and  aCz  most  strongly*  For  ttye 
theta  band*  discrimination  was  achieved  in  both  the  P3a  (p<5  x  10  ) 
and  RP  (p<l  x  10  )  intervals*  In  the  P3a  interval*  aOz*  aCz*  C3*  C4 
and  Fz  were  the  main  channels  used)  and  in  the  RP  interval  it  was  P4* 
Pz  and  Fz*  For  the  low  glpha  band*  discrimination  was  achieved  in  the 
RP  interval  at  p<5  x  10  »  using  Pz*  C3  and  P4.  For  $tye  high  alpha 

band  discrimination  in  the  RP  interval  was  at  p<5  x  10  using  aCz  and 
Fz*  Discrimination  was  not  achieved  for  beta  band  power  in  either 
interval.  In  general*  the  direction  of  the  between-task  difference  in 
power  was  not  the  same  for  a  given  channel  in  the  different  frequency 
bands* 


D •  Conclusions 

These  preliminary  results  suggest  somewhat  that  the  between-tasks 
differences  in  inter-electrode  correlations  and  covariances  may  not  be 
due  solely  to  voluee  conduction  of  potentials  from  a  single  distant 
generator.  First*  there  was  discriminatory  information  in  the  maximum 
covariance  measure*  which  was  often  found  at  non-zero  lags*  Second* 
there  was  information  in  the  shape  of  the  lagged  covariance  function 


which  was  sensitive  to  the  phase  relation  between  two  signals.  Third, 
when  the  power  measure  of  a  channel  was  greater  for  one  task,  power  on 
a  highly  correlated  channel  was  seen  to  be  lower  for  that  task.  For 
example,  the  C3-a0z  covariance  was  greater  for  move  than  no-move  task 
in  the  delta  band  (Figure  9).  In  this  case.  aOz  delta  power  was 
greater  for  the  move  task,  but  C3  delta  power  was  lower  (Figure  12). 
If  correlation  was  due  solely  to  volume  conduction  from  a  single 
generator,  power  for  both  correlated  channels  would  show  the  same 
between-task  variation.  Of  course,  the  suggestion  that  separate 
generators  contribute  to  the  reported  between-task  differences  in 
scalp  correlation  patterns  is  mere  speculation.  Further  studies  will 
be  required  to  determine  if  this  is  actually  so  and  if  pairwise 
interchannel  measures  are  the  best  way  to  characterize  the  activity  of 
such  generators. 

Significant  differences  between  tasks  were  found  to  be  specific  to 
certain  frequency  bands.  In  particular,  all  covariance-derived 
measures  were  significant  only  in  the  delta,  theta  and  beta  bands.  In 
some  cases  (e.g.  the  shape  measure  in  the  RP  interval)  a  measure 
differentiated  the  tasks  in  only  one  band.  Only  for  the  power  measure 
was  there  any  discrimination  in  the  alpha  bands. 

Specificity  was  also  achieved  in  the  type  of  measure  which 
distinguished  the  tasks.  Zero-lag  correlation  depends  on  the  timing 
of  two  signals  as  well  as  their  similarity.  These  two  aspects  were 
separated  in  the  lag  and  shape  measures  on  the  one  hand,  and  the 
maximum  covariance  on  the  other.  These  measures  were  found  to  have 
different  abilities  to  discriminate  in  the  different  frequency  bands. 
Since  the  between-channel  covariance  measures  differentiated  tasks 
differently  than  the  power  measures,  such  measures  may  provide 
information  about  the  brain  which  complements  that  obtained  from  power 
measures. 

Further  investigation  is  proceeding  in  several  ways.  An  improved 
shape  measure  which  carries  information  as  to  lead  or  lag  between 
channel  pairs  has  been  developed.  An  improved  single  channel  power 
analysis  will  make  more  explicit  the  similarities  and  differences 
between  single  and  multichannel  measures.  Additional  studies  will 
fill  in  the  gaps  in  the  present  study  from  non-lagged  correlations  to 
lagged  covariances. 
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Table  4  -  Classification  accuracy  at  different 
levels.  (1206  ^trials  from  4  persons) 
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THETA  BAND  COVARIANCE-  MOVE 

8681-4.  280TRIALS.  4-8HZ.  P33  INTERVAL 


THETA  BAND  COVARIANCE-  NO  MOVE 

SSS  1-4.  260  TRIALS.  4-8  HZ.  P3d  INTERVAL 
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Figure  7  -  Spectral  component  hlatograa  (participant  #3) 
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Figure  10 


UI.  DISTINCT  BRAIN -POTENTIAL  PATTERNS  ACCQHPANYING  BEHAVIORALLY 
Ifi.ENTICAl  TRIALS  (Also  sponsored  Jiy  tile  Office  Q_f  Naval  Research) 

In  order  to  examine  patterns  used  by  the  pattern  recognition  algorithm 
to  define  the  move  and  no-move  trials*  the  classification  assigned  by 
the  algorithm  to. each  trial  of  the  testing  data  was  noted*  In  all 
cases*  the  data  were  behaviorally  correct*  Trials  for  which 
classification  was  correct  for  both  P3a  and  RP  intervals  were  called 
correct*  those  with  incorrect  classification  for  both  intervals  were 
called  incorrect*  This  was  done  for  both  move  and  no-move  conditions* 
resulting  in  four  classes*  (a)  correct  move*  (b)  correct  no-move*  (c) 
incorrect  no-move*  and  <d)  incorrect  move.  Unfiltered  ERPs  were 
formed  for  each  class  for  the  data  of  the  last  4  people  in  the  study 
(Figure  13). 

The  main  difference  between  correctly  classified  move  and  no-move  ERPs 
was  the  positive  P3a  and  P3b  peaks  at  approximately  365  and  530  msec 
post-stimulus*  respectively.  Comparing  Figure  13c  with  Figure  13b* 
the  incorrect  no-move  ERP  is  seen  to  lack  a  P3a  peak  and  have  a 
smaller  P3b  peak*  thus  resembling  the  correct  move  ERP.  The 
incorrectly  classified  move  trials  (Figure  13d>  have  a  more  distinct 
P3b  peak  than  the  correctly  classified  move  trials  (Figure  13a)*  thus 
resembling  the  correctly  classified  no-move  ERP* 

Another  obvious  difference  between  correctly  and  incorrectly 
classified  ERP's*  both  move  and  no-move*  was  the  strong  pre-stimulus 
alpha  'train*  in  incorrectly  classified  ERPs.  This  dissimilarity  is 
clearly  seen  in  alpha  band-pass  filtered  averages  (Figure  14).  In 
both  the  correct  and  incorrect  move  conditions  there  are  alpha  band 
ERPs  which  occur  at  the  same  post-stimulus  time  (in  phase).  In  the 
incorrectly  classified  waveform  the  pre-stimulus  alpha  is  much  larger 
than  in  the  correct*  and  is  phase  reversed.  The  incorrect  ERP  appears 
to  undergo  a  phase  adjustment  prior  to  the  zero-crossing  at 
approximately  90  msec  post-stimulus*  which  occurs  at  the  same  time  in 
the  correctly  classified  trials*  and  is  followed  by  a  negative  peak  at 
160  msec  in  both.  This  peak  corresponds  to  the  N163  peak  in  the 
unfiltered  ERP.  This  could  reflect  a  timing  process  which  regulates 
the  activity  of  sensory  cortex  in  preparation  for  incoming  stimuli 
(the  old  idea  of  the  'neuronic  shutter').  These  alpha-band  filtered 
ERP's  are  also  clearly  different  in  the  P3a  and  RP  intervals  where  the 
classification  was  made.  The  high  prestimulus  alpha  in  the 
incorrectly  classified  trials  may  be  related  to  cognitive  state*  so 
that  incorrectly  classified  trials  are  qualitatively  different* 
perhaps  due  to  automatic  processing*  Alternatively*  incorrectly 
classified  trials  may  be  those  with  a  particular  alpha  phase  at 
stimulus  onset*  resulting  in  enhanced  summation  of  pre-stimulus  waves* 
and  difference  in  post  stimulus  activity.  These  possibilities  are 
being  further  investigated  since  the  results  show  that  different 
neural  patterns  may  accompany  the  same  behavior. 


CORRECTLY  CLASSIFIED  MOVE  TASK 


1317  Trials  Total,  8-15  Nz) 

Figure  14  • 
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